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^'^This  paper  outlines  a  three-step  plan  for  generating  English  text  from  any 
semantic  representation  by  applying  a  set  of  syntactic  transformations  to  a 
collection  of  kernel  sentences.  The  caper  focuses  on  describing  a  program 
which  realizes  the  third  step  of  this  plan.  Step  One  separates  the  given 
representation  into  groups  and  generates  from  each  group  a  set  of  kernel 
sentences.  Step  Tow  must  decide,  based  uoon  both  syntactic  and  thematic 
considerations,  the  set  of  tranformations  that  should  be  performed  upon  each 
set  of  kernels.  The  output  of  the  first  two  steps  provides  the  '^TASK*  for  - 
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step  Three,  Each  element  of  the  TASK  corresponds  to  the  generation  of  one  Enrlish 
sentence,  and  in  turn  may  be  defined  as  a  triple  consisting  of:  ,(j0,  a  list  of  kernel 
phrase  markers;  (Ik/  a  list  of  transformations  to  be  performed  upon  the  list  of  kernels- 
{£)  a  "syntactic  separator"  to  separate  or  connect  generated  snetences.  Steo  Three  takes 
as  input  the  results  of  Step  One  and  Step  Two.  The  program  which  implements  Steo  Three 
"reads"  the  TASK,  executes  the  transformations  indicated  there,  combines  the  altered 
kernels  of  each  set  into  a  sentence,  performs  a  pronominal ization  process,  and  finally 
produces  the  appropriate  English  word  string.  This  approach  subdivides  a  hard  problem 
into  three  more  manageable  and  relatively  independent  piecesj^It  uses  linguistically 
motivated  theories  at  Step  Two  and  Step  Three.  As  implemented  so  far.  Step  Three  is 
small  and  highly  efficient.  The  system  is  flexible;  all  the  transformations  can  be 
applied  in  any  order.  The  system  is  general;  it  can  be  adapted  easily  to  many  domains. 
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AOSI'RACI':  ITiis  paper  outlines  a  thrcc-stcp  plan  for  generating  I'nglish  ti!xt  from  any  semantic 
representation  by  applying  a  set  of  syntactic  transformations  to  a  collection  of  kern  .’1  sentences.  The  paper 
focuses  on  describing  a  program  which  realizes  the  third  step  of  diis  plan.  Step  One  separates  the  gi\en 
r.'prcsent.ilion  into  groups  and  generates  from  each  group  a  set  of  kernel  .sentences.  Step  I  wo  must  decide, 
based  upon  both  syntactic  and  thematic  considerations,  die  set  of  transformations  that  should  be  performed 
upon  each  set  of  kernels.  The  output  of  the  first  two  steps  provides  the  "TASK  ’  for  Step  I  hioe.  l-ach 
e  ement  of  the  TASK  corresponds  to  the  generation  of  one  English  sentence,  and  in  I'.ifn  ina;,  be  de'fincd  as  a 
triple  consisting  of:  (a)  a  list  of  kernel  phrase  markers;  (b)  a  list  of  transformations  to  be  pci  formed  upon  ilic 
list  of  kernels;  (c)  a  "syntactic  separator"  to  separate  or  connect  generated  sentences.  Step  Throe  hikes  as 
input  tlie  results  of  Step  One  and  Step  Two.  I  he  program  which  implements  Step  I  hreo  "reads"  the  TASK, 
executes  the  transformations  indicated  Uicrc,  combines  the  altered  kernels  of  each  set  into  a  sentence, 
performs  a  pronominalization  process,  and  finally  produces  the  appropriate  l-inglish  word  string.  This 
approach  subdivides  a  hard  problem  into  tltrec  more  manageable  and  relatively  independent  pieces.  It  uses 
linguistically  motivated  tlicories  at  Step  Two  and  Step  fhiec.  As  implemented  so  tar.  Step  Three  is  small 
and  highly  efficient.  The  system  is  flexible;  all  the  translormations  can  be  applied  in  any  ordei .  The  system 
is  general;  it  can  be  adapted  easily  to  many  domains.  Below  is  an  actual  example  of  luiglish  text  generated 
by  the  program  from  the  kernels  and  transformations  of  an  appropriate  input  TASK: 

"Al  the  beginning  of  the  story  Lady  Macbeth  is  bothered  by  the  fact  that  Macbeth  is  not  the  king.  Macbeth  who  was 
a  nobleman  is  persuaded  by  her  to  murder  the  king  with  a  knife  because  she  wants  Macbeth  to  be  the  king.  She  dies  and 
Macbeth  becomes  unhappy.  Macduff  didn  't  see  Macbeth  murder  the  king.  In  the  end  Macbeth  is  killed  by  Macduff  who 
Mas  a  good  friend  of  the  king.  iVere  there  some  other  stories  written  by  Shakespeare?" 


This  research  was  done  at  the  Artificial  Intelligence  Eaboratory  of  the  MassachusetLs  Institute  of  Technology. 
Support  for  the  I  .aboratory's  artificial  intelligence  research  is  provided  in  part  by  the  Advanced  Research 
Projects  Agency  of  the  Dcp.irtment  of  Defense  under  Office  of  Naval  Research  contract  N00()14-80-C-0505. 

®  MASSAOWSfm  INSTITUTE  OF  TECHNOLOGY  IMP 


t)8  16 


120 


Kill/. 


-2- 


liuroduclion 


§0.  Introduction 

Suppose  lluit  a  computer  couliiins  a  semantic  representation  of  a  cerUiin  seque  ice  of  events  or  fiicts. 
For  many  reasons,  it  is  useful  to  geneniie  English  text  from  such  a  rcprcsentiition.  This  paper 
outlines  a  three-step  plan  for  generating,  English  text  from  any  sem;inlic  representation  by  applying 
a  set  of  syntactic  transformations  to  a  o  llection  of  kernel  sentences  or  phrase  markers.'  The  paper 
f.Kuses  on  describing  a  program  called  (JEN  which  realizes  the  third  step  of  this  plan. 

Step  One  of  the  Language  Generation  Procedure  (LGP)  separates  the  given  semantic 
representation  into  groups  and  generates  from  each  group  a  set  of  kernel  phra  se  markers.  A  phrase 
marker  can  be  used  in  one  of  several  syntactic  roles:  a  matrix  clause  K^,  an  embedded  clause  K^.  or 
a  relative  clause  K^.  The  role  of  a  given  phrtise  marker  must  be  specified  in  Step  One. 

SLe^  Two  of  the  LGP  must  decide,  based  upon  both  syntactic  and  thematic  considerations,  the  set 
of  transformations  that  should  be  perfoi  nied  upon  each  set  of  kernels. 

The  output  of  the  first  two  steps  provides  the  input  for  Step  Three.  We  will  sometimes  refer  to  this 
input  as  the  "TASK"  for  Step  Three.  Each  element  of  the  TASK  corresponds  to  the  generation  of 
one  English  sentence,  and  in  turn  may  be  defined  as  a  triple  consisting  of: 

(a)  a  list  of  kernel  phrase  markers  generated  by  Step  One; 

(b)  a  list  of  transformations,  obtained  from  Step  Two,  to  be  performed  upon  the  list  of 
kernels; 

(c)  a  "syntactic  separator"  (punctuation  mark,  conjunction,  etc.)  to  separate  or  connect 
generated  sentences. 

Step  Tlirec  takes  as  input  the  results  of  Step  One  and  Step  Two.  The  program  GEN  which 
implements  Step  Three  of  the  generator  "reads"  the  TASK,  executes  the  transformations  specified 
there,  combines  the  altered  kernels  of  each  set  into  a  sentence,  performs  a  pronominalization 
process,  and  finally  produces  the  appropriate  English  word  string.^ 


1.  Itie  ddinilton  and  the  structure  of  kernel  phrase  maMenfSemanlic  Frame  Structure)  is  described  in  Section  1. 

2.  A  comprehensive  review  of  previous  approaches  to  language  generation  can  be  found  in  (McDonald  1980]. 
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For  example,  given  the  following  kernels:^ 

=  a  young  woman  asked  it  { 1) 

Kj  =  this  man  ate  the  cake 

the  program  can  apply  cliflerent  sets  of  transformations  for  altering  the  individual  senlcnces  or 
c ombining  them.  Among  the  possible  outputs  are:"* 

1.  After  0-NPj-  l  Oj!  A  young  woman  asked  this  man  to  cal  the  cake. 

2.  After  QUHS  flON;  Hid  a  young  woman  ask  tliis  man  to  eat  tlic  cake? 


3.  After  NOTj.' 


Did  a  young  woman  ask  this  man  not  to  cat  the  cake’ 


4.  After  FASSIVK;  Was  tliis  man  asked  by  a  young  woman  not  to  cat  the  cake? 


5.  After  NT: 


Wasn't  tliis  man  asked  by  a  young  woman  not  to  cat  tlic  cake? 


Suppose  that  the  program  GEN  takes  as  input  the  following  TASK: 

TASKl  =  ((K„  K,)  Question)  (?)) 

According  to  this  TASK,  the  program  applies  the  transformation  O-np^-io  to  the  embedded  clause 
Kj  and  the  transformation  Question  to  the  matrix  clause  Ky.  Then  the  altered  kernels  are  combined 
and  the  resulting  output  is:  "Did  a  young  woman  ask  this  man  to  eat  the  cake?"  which  is  sentence 
#2  in  (2).  If,  for  instance,  we  want  to  obtain  sentence  #5  from  the  set  (2)  above,  the  input  TASK 
should  be: 

TASK2  =  ((Kp  Kj)  (0-npj-/Oj  Question  Not^  Passive  N’t)  (?)) 

The  last  step  of  the  l  anguage  Generation  Procedure  uses  three  different  classes  of  syntactic 
operations  to  "solve"  tlie  TASK  provided  by  Step  One  tuid  Step  Two:  the  system  of  optional 
commutative  Transformations,  the  set  of  Transformational  Filters  whose  application  is  obligatory 
only  if  certain  conditions  arc  met,  and  the  set  of  intrinsically  ordered,  obligatory  Adjustments. 


3.  The  word  U  is  used  here  as  a  joining  point. 

4.  For  convenience,  we  append  ”1"  to  the  name  of  a  transformation  which  will  be  applied  to  an  embedded  clause,  and 
"2"  to  a  iranslormalion  that  will  be  applied  to  a  relative  clause.  Nothing  is  appended  to  the  matrix  eliiuse.  ITie 
significance  of  the  names  of  iransfomialions,  such  as  O-NP.-IO.  will  be  explained  below  in  Section  6. 
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Below  is  an  aciiial  example  of  Fnglish  ;exl  generated  by  the  program  GI  N  from  the  kernels  and 
transformations  of  an  appropriate  input  TASK;* 


An  old  professor  wanted  t  large  Fnglish  class  to  learn  a  story  about 
Macbeth.  He  didn't  notice  a  young  man  and  a  young  lad)  eating  a  huge 
cake  under  the  desk.  They  were  in  danger,  weren't  they?  f  ortunately  the 
people  who  loveil  the  story  i  boiit  Macbeth  ditl  not  see  them  either.  Hear  it 
now !  At  the  beginning  of  t  ic  story  l  ady  Macbeth  is  bothered  by  the  fact 
that  Macbeth  is  not  the  king..  Macbeth  who  w'as  a  nobleman  is  persuaded 
by  her  to  murder  the  king  with  a  knife  because  she  wants  Macbeth  to  be 
the  king.  She  dies  and  Macbeth  becomes  unhappy.  MacdiilT  didn't  see 
Macbeth  murder  the  king.  In  the  end  Macbeth  is  killed  by  MacdidT  who 
was  a  good  friend  of  the  kitg.  Were  there  some  other  stories  written  by 
Shakespeare?  ^ 


I  he  pronouns  found  in  this  example  wee  not  present  in  the  input  TASK,  but  were  created  by  the 
program.’ 


Among  the  advantages  of  this  approach  are: 

-  it  nicely  subdivides  a  hard  problem  into  three  more  manageable  pieces,  such  that  each  is 
relatively  independent  of  the  others 

-  it  uses  linguistically  motivated  theories  at  Step  Two  and  Step  Three  of  the  LGP 

-  as  implemented  so  far,  Step  Three  is  small  and  highly  efficient 

-  the  system  is  flexible;  all  the  transformations  can  be  applied  in  any  order 

-  the  system  is  very  general:  it  can  be  adapted  easily  to  many  domains. 


5.  The  following  fragments  show  llie  structure  of  the  TASK: 


(K(j= An  old  professor  wanted  it;  Kj  =  A  large  English  class  learns  a  story  about  Macbeth)  (0-npj-roj) 


(.) 


(K(j= Macduff  saw  it;  Kj  =  Macbeth  murdered  the  king) 

(Ky=:ln  the  end  Macduff  kills  Macbeth  ;  K2  =  Macduffwasagood  friend  of  the  king) 
( Kg = Shakespeare  wrote  some  otlier  stories) 


(N't  O-np^-inf^)  (.) 

(Relative-^  Passive)  (.) 

(Question  Passive  There)  (?) 


6.  The  author  apologizes  for  possible  historical  inaccumey  in  the  computer  output. 

7.  fhe  pronominiilization  procedure  is  described  in  the  Appendix  1. 
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§1.  Semantic  Tranic  Structure 

We  will  assume  that  the  input  semantic  representatiDn  consists  of  a  set  of  frames.*  Step  One  t)f  the 
I  anguage  Generation  Procedure  builds  from  the  given  represenlation  a  set  of  r.cmvl phrase  markers 
using  three  types  of  templates  (noun-template,  verb-template,  adverb-template)  and  two  operations 
(concatenation  and  conjunction)  that  assemble  them,  fhe  structure  of  tin  templates  is  shown 
below: 

noun-template  (NT)  =  (prep*  det*  adj*  noun) 
verb-template  (VT)  =  (tense  auxl  aux2  au.\3  verb) 
adverb-template  (AT)  =  (mod  adverb) 

Here  prep,  det,  adj,  aux,  mod  ate,  respectively,  abbreviations  for  preposition,  ('elerminer.  adjective, 
auxiliary  and  modifier.  The  superscript  *  indicates  that  a  string  of  one  or  more  symbols  or  their 
conjunction  is  allowed.  Tense  also  carries  the  grammatical  features  of  NP^  --  its  number,  person, 
and  gender. 

Each  template  is  implemented  as  a  list  of  pairs,  an  association  list.  The  first  element  of  the  pair  is 
the  name  of  the  constituent,  the  second  is  its  value.  All  constituents  are  optional.  If  any  constituent 
is  absent,  its  value  in  the  template  is  nil. 

Given  below  are  some  sample  templates: 

N'f  =  ((prep  nil)  (del  a)  (adj  (young  pretty))  (noun  lady))  "a  young  pretty  lady" 

NT  =  ((prep  with)  (del  (all  the))  (adj  nice)  (noun  books))  "with  all  die  nice  books" 

N'f  =  ((prep  (from  out  oO)  (dot  the)  (adj  nil)  (noun  darkness))  "from  out  of  the  darkness" 

V  C  =  ((tense  past)  (auxl  can)  (aux2  have)  (aux3  nil)  (verb  notice))  "could  have  ttoticed" 

A  r  =  ((mod  very)  (adverb  well))  "very  well" 

The  following  two  operations  are  allowed: 


8.  The  term  "frame"  was  introduced  in  [Minsky  1975].  The  Frame  Represenlation  Liinguaec  (FRL)  developed  in 
(Roberts  and  Ooldstein  1977)  can  be  used  as  an  example  of  such  represenlation.  In  this  paper,  Itowcver,  for  testing 
purposes  we  will  consider  a  set  of  kernel  phrases  as  the  input.  A  parser  has  been  designed  and  implemented  in  onler  to 
process  the  kernel  phrases.  The  description  of  the  parser  can  be  found  in  the  Appendix  2. 


KilU 


-6- 


SciiMiuic  1  lamc  Sii  uciure 


1.  Concatenation:  C0NC(X1  X2)  — ->  XI  X2 

2.  Conjunction:  CONJ  (XI  X2)  — ->  XI  conj  X2 

V  here  XI  and  X2  are  two  templates  of  the  same  type,  and  conj  is  a  conjniKiion  such  as.  and.  or.  etc. 

I  he  structure  of  tlic  frames  can  be  defined  in  terms  of  the  templates  and  operations,  as  follows: 

.\oun-rrame(NF]  is  any  appropriate’  sequence  of  applications  of  the  operations  CONC  and 
CONJ  applied  to  the  noun-template  NT. 

yerb- frame  (VF)  and  adverb-frame  (AF)  are  defined  in  the  siime  manner,  as  a  sequence  of 
applications  of  CONC  and  CONJ  applied  to  V  T  and  AT.  respectively. 

1  he  noun-frame  will  be  called  prcposiiionless  ifil  dix^s  not  begin  with  a  preposition. 

For  example: 

rjf'  =  ((prep  nil)  (det  nil)  (atlj  nil)  (noun  Ivan)  (conj  and) 

(prep  nil)  (det  nil)  (adj  nil)  (noun  Maria))  =  "Ivan  and  Maria". 

[{ach  of  the  prcpositionicss  noun-frames  in  a  sentence  htts  a  particular  semantic  role  as.sociated  with 
it:  agent,  goal,  or  theme. 

Agent  is  a  thing  that  causes  the  action  to  occur. 

Goal  is  the  recipient  or  the  beneficiary  of  the  action. 

Theme  is  a  thing  that  undergoes  a  state  of  change. 

As  an  example,  in  the  sentence  "Ivan  gave  Maria  all  his  money",  Ivan  is  the  agent  who  causes  the 
action  to  happen;  Maria  is  the  goal,  as  the  beneficiary  of  his  action;  and  all  his  money  is  the  theme 
that  transfers  from  Ivan  to  Maria. 

To  construct  a  kernel  phrase  marker  we  have  to  put  together  a  subset  of  the  following  set  of  frames: 

NF^"'*',  NF"^^'-’"'".  NF’^"-'^.  AF"''''-^’,  AF™'''’'’',  AF""^,  VF  (3) 

Here  NF'®'"',  NF'^®',  and  NF"’*'"''^  are  noun  frames  that  play,  respectively,  the  roles  of  age/j/,  goo/. 


9.  Itie  present  paper  will  not  discuss  restrictions  on  the  usage  of  these  two  operations.  This  issue  properly  belongs  to 
Step  One  of  the  Language  Generation  Procedure. 

10.  In  the  implementation  we  have  as.sumed  that  the  verb-frame  VF  =  tense  auxl  aux2  aux3  verb. 
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(*r  iheme  in  a  sentence;''  NP'""“'  and  NF"""'  arc  noun  frames  that  will  bo  iransformod  later  into 
the  inn  '  and  final  prepositional  phrases;  AF""""'.  aF'"'"'"''.  and  AF"'‘ ''  are  adverb  frames  that  will 
be  transformed  into  adverbs  in  initial.  I'ledial,  and  final  positions.  All  these  elements  arc  optional. 

In  the  actual  implementation  kernel  pi  rase  markers  have  the  structure  of  an  association  list.  We 
will  call  it  a  Semantic  Frame  Structure  (SFS).  Ihc  Fnglish  word  string  corresponding  to  the 
Semantic  Frame  Structure  of  a  kernel  phrase  marker  we  will  call  a  kernel  sentence. 

Ia)r  instance,  the  Semantic  Frame  Structure  for  the  kernel  sentence  "Yesterday  the  young  man 
b aught  Maria  a  beautiful  present"  is: 

((AF"‘'""i  ((mod  nil)  (adverb  yesterday))) 

(NF'^"'  ((prep  nil)  (del  the)  (adj  young)  (noun  man))) 

(VF  ((tense  past)  (auxl  nil)  (aux2  nil)  (aux3  nil)  (verb  buy))) 

(NF'"™'  ((prep  nil)  (det  nil)  (adj  nil)  (noun  Maria))) 

(NF"’™'"  ((prep  nil)  (det  a)  (adj  beautiful)  (noun  present)))) 

A  set  of  such  Frame  Structures  together  with  a  set  of  transformations  to  be  performed  upon  them  is 
tie  input  to  the  program  GFN.  (he  program  docs  not  require  any  order  of  constituents  in  the  SFS. 
but  the  following  phrase  structure  rules  are  assumed  for  kernel  sentences;'^ 

KF  ->  SF  VF  CF 

SF  ->  NF^*"‘  (4) 

...y  Npsoa*  [Siplheme  ji^pfinal 

where  KF  stands  for  kernel  frame,  SF  -  subject  frame,  VF  -  verb  frame,  CF  -  complement  frame. 
Given  these  phrase  structure  rules,  the  general  form  of  a  kernel  phrase  marker  is: 

|^pinili.Ti  jvjpagonl  yp  |>jpBoaI  jvjpthcme  j^pHnal 

As  an  example,  here  is  the  Semantic  Frame  Structure  for  the  sentence  "that  young  man  with  black 
eyes  could  have  been  teaching  our  class  in  Boston": 


11.  In  Section  7  we  will  describe  how  the  semnntic  roles  associated  with  the  noun-frames  arc  used  to  define  the 
transformation  Dalive  Stovemrnt  imd  its  interaction  with  Passive. 

12.  Adveib  flames  Ar'"'"''.  AF""'''''',  and  AF'"’''  have  b<,-en.  for  simplicit>,  left  out  of  the  phrase  structure  rules. 
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((Nf  ((prep  nil)  (del  that)  (adj  yoiiii}*)  (luuin  man) 

(prep  with)  (del  nil)  (adj  black)  (noun  eyes))) 

(VF  ((tense  past)  (aiixl  can)  (au\2  have)  (aiix3  be)  (verb  teach)))  (6) 

(Nl  '  ((prep  nil)  (del  our)  (adj  nil)  (noun  class))) 

(NF*'"  “  ((prep  in)  (del  nil)  (ailj  nil)  (noun  Hoston)))) 

§2.  I  ransrurmational  Structure 

Hie  Senianlie  Frame  Sirucinre  provides  a  semantic  description  of  a  kernel  sentence  which  includes 
consiiiuenis  such  as  NF'^'"'.  NF'"'"',  and  NF"'^'"\  Because  these  semantic  coastiluenis  represent  in 
some  sense  a  part  of  the  underlying  "meaning"  of  the  sentence,  their  values  do  not  change  after 
applying  transformations.  However,  the  SFS  does  not  give  a  syntactic  representation  complete 
enough  to  allow  transformations  to  be  directly  applied.  We  must  first  construct  an  augmented 
representation  from  the  Semantic  Frame  Structure,  the  Transformational  Structure  (  IS),  which 
gives  a  structural  encoding  of  the  information  in  the  sentence.  This  structure  will  serve  as  the 
domain  of  application  for  all  iransfonrations.  The  I  ransformational  Structu.e  consists  of  syntactic 
constituents  such  as  noun  phrases  (NP).  prepositional  phra.ses  (PP).  au.xiliary  system,  several  chimmy 
elcment.s.  etc.  The  process  of  building  the  rransformational  Structure  from  the  Semantic  Frame 
Structure  is  described  as  follows: 

(a)  fhe  noun  phrases  and  the  prepositional  phrases  of  the  I  S  arc  derived  from  the  noun  frames  of 
the  SFS.  Each  noun  phrase  indicates  a  certain  fixed  position  in  the  I  ransformational  Structure: 
NPj-position.  NPj ^-position,  or  NP^-position.'^  Each  noun  phrase  is  associated  with  one  of  the 
prepositionless  noun  frames  NP""',  or  NF"’'""^  in  the  Semantic  Frame  Structure  and 

derives  its  value  from  the  noun  frame.  The  value  of  a  noun  phrase  is  a  "two-tuple";  it  consists  of  a 
senianlie  value,  w  hich  is  taken  from  the  name  of  die  noun  frame  and  which  indicates  the  role  that 
the  noun  phrase  plays  in  the  sentence:  agent,  goal,  or  theme,  and  a  lexical  value,  which  is  the  actual 
word  string  in  the  noun  phra.se.  I  ransformations  (for  example.  Passive  or  Dative  Movement)  may 
interchange  the  values  of  noun  phrases;  therefore,  after  such  a  transformation  has  been  applied,  the 
alTected  noun  phrase  receives  not  only  the  new  word  string  as  its  lexical  value,  but  also  the  new 


13.  l.ater  on  by  a  reference  to  a  noun  phrase  NPj,  NP,  j.  or  NP^,  we  will  mean  the  noun  phrase  which  is  located  in  the 
corresponding  position  in  the  I  ransformational  Structure.  For  instance,  reference  to  NP,  calls  R)r  a  noun  phrase  in  the 
NP|-posiiion  in  the  TS. 
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seinatuic  role  as  its  semantic  value.  In  Section  7  we  will  describe  how  this  important  rcatiirc  is  used 
to  deline  the  transformations  of  Dative  Movement  and  Passive. 

We  will  assume  that  the  noun  phrases  NP^.  NP^.  and  NP,  initially  obtain  their  \alues  from  the 
I’ames  NP‘“^  and  respectively.  If  only  two  noun  frames  NF"  '  and  Nl-  '  ' 

;re  present  in  the  input  Semantic  Frame  Structure,  the  corresponding  I  ransformatiDnal  Structure 
\  'ill  have  only  two  NP-posilions:  NP^  and  NP,."  If  there  is  otily  one  noun  frame  NF'‘'‘ '  in  the 
SFS.  there  will  be  only  one  noun  phrase  NPj  in  the  TS.  The  Semantic  Frame  Structure  in  the 
c.xample  (6)  will  be  transformed  to;'^ 

((NP|  (That  young  man  with  black  eyes)) 

(TENSE  past)  (AUXl  can)  (AUX2  have)  (AUX3  be)  (VERB  teach)  (7a) 

(NP,  (our  class))  (pp'"'"*  (in  Boston))) 

(o)  A  special  procedure,  "affix  stripping",  is  accomplished  on  the  auxiliary  elements  of  the 
'  erb-frame  to  separate  each  auxiliary  verb  from  its  affix.’*’  The  affixes  of  the  auxiliaries  Modal,  BE. 
and  HAVE  are.  respectively,  0,  en,  and  ing.  The  notation  reflects  the  fact  that  in  an  English 
sentence  after  a  Modal  comes  an  infinitive,  after  HAVE  comes  the  past  participle,  and  after  BE 
comes  the  progressive  form  of  the  verb  [Chomsky  1957].  If  the  sentence  has  r-o  ttuxiliary  verbs  in  it. 
the  auxiliary  do  (without  an  affix)  is  inserted  as  a  value  of  the  AUXl. 

((NPj  (That  young  man  with  black  eyes)) 

(TENSE  past)  (AUXl  can)  (AFFIXI  0)  (7b) 

(AUX2  have)  (AFF1X2  en)  (AUX3  be)  (AFFIX3  ing)  (VERB  teach) 

(NPj  (our  class))  (PP''  "’’  (in  Boston))) 

(c)  Several  dummy  elements  are  inserted  in  the  TS  which  are  left  unspecified’^  until  the  appropriate 
transformation  activates  them  and  ;tssigns  the  necessary  values.  Two  elements  NEGl  and  NEG2 
that  will  be  used  in  the  coitlractcd  and  full  forms  of  English  negative  arc  inserted  after  the  first 
auxiliary  verb.  COMP  is  inserted  in  the  beginning  of  the  structure  and  INFL  -  before  the  first 
auxiliary  verb.  These  will  be  used  in  constructing  different  embedded  clauses.  Thus  the  Semantic 

I  t  Itiis  is  the  reason  for  hav  ing  tlio  obscure  indices  1, 1.5,  and  2  for  the  noun  phrases. 

15.  In  ihese  iliagr.ims  wc  do  not  show  the  semantic  values  of  the  noun  phr;ises. 

16.  The  iiuersc  operation.  Affix  Hopping,  which  is  performed  after  all  the  transfomiations  have  been  applied,  attaches 
every  affix  to  the  iniineiliately  following  verb. 

17.  In  the  implementation  the  values  of  unspecified  elements  NEGl.  Nl'G2,  COMP,  and  INI't.  are  names  of  those 
elements. 
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I  lamc  Slriicluro  (6)  luis  now  been  iransruniied  iiiU)  1  raiisibrmalional  Sirueliiie  (7e)  on  whieh 
transfonnations  can  operate; 

(((’OMP  eonip)  (NP^  (lliat  yoii.ig  manwitli  black  eyes)) 

(ICNSK  past)  (INI  I  inll)  {AU\!  can)  (NHGl  negl)  (N1G2  neg?)  (AITIXl  0)  (7e) 

(AUX2  have)  (A1  1  !X2  en)  (AJX3  be)  (Al  l  1X3  ing)  (\ I:RI)  teach) 

(NPj  (oiir  class))  (pp  ' (in  Boston))) 

'  he  I  raiisformational  Structure  of  a  kernel  sentence  is  a  flm  list  sirudure  which  suggests  a  more 
s  mple  and  flexible  way  to  define  anj  perform  the  transformations.  On  the  oilier  hand,  the 
s  'litence  obtained  after  combining  se.eral  kernel  sentences  is  representeci  as  an  embedded  list 
iirucliire  (tree  structure).  I'his  allows  the  application  of  the  inunf annul innal  fillers  across  the 
kernels  (see  Section  6).  and  also  perinitr  an  easier  interface  with  the  results  of  other  researchei  s.  for 
example,  sentence  internal  pronominali  'ation  (sec  {l.a.snik  1976].  [Reinhart  1976).  [Sidner  1979j). 


§3.  Iransformations  and  Adjustments 

Let  K  be  a  surface  word  string  that  corresponds  to  the  input  Scmai  '.ic  Frame  Struciure.  In  Seciion 
1.  it  has  been  described  how  the  Semantic  Frame  Structure  SFS(K)  is  mapped  into  the 
■fransformationa!  Structure  TS(K).  The  Transformational  Structure  serves  as  ihe  domain  of 
application  for  all  T nvisformations  listed  in  the  input  TASK.  However,  after  all  the  transformations 
have  been  applied,  the  resulting  Transformation  Structure  TS  (K)  cannot  yet  be  the  source  for  the 
correct  Fnglish  word  string.  Additional  "clean-up"  operations  on  the  Transformational  Structure. 
Adjustments,  must  be  employed  in  order  to  obtain  the  grammatical  output  -  the  altered  kernel  K  . 
l.et  us  consider  this  pnxess  in  detail; 

(a)  flic  Semantic  Frame  Structure  of  the  kernel  sentence  K  is  mapped  {M}  into  a  I'ransformational 
Structure  rS(K). 

(b)  A  set  of  transformations  { I }  is  applied,  tbch  transfonnation  operates  on  the  I'ransformational 
Structure,  alters  it  and  passes  tlic  altered  structure  to  the  next  transformation. 

(c)  A  set  of  special  "clean-up"  adjustments  {.A}  is  activated  in  order  to  get  the  tciminal  I'nglish  word 

♦  * 
siring  K  .  I  he  adjustments  operate  on  tlic  altered  Transformational  Structure  TS  (K). 

The  following  ditigram  (8)  illustrates  this  process; 


{M}  m  ^  {A} 

>  TS*(K)  . >  K* 


SFS(K) 


>  TS(K) 


(8) 


Kalz 
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Diagram  (8)  provides  a  way  to  define  Tninsformaliuns  and  AJjusimcnls  uhicli  shows  an  iiiu  resiing 

and  iinporiani  ilislinelion  between  them  based  on  tomparing  ilie  input  kernel  sentenee  K  with  (he 

* 

output  word  string  K  . 

Definitions: 

.Assume  that  the  set  of  transformations  {T}  is  empty.  A  set  of  opi  rations  jA}  on  the 
I  ransformational  Structure  IS(K)  of  an  input  kernel  sentence  K  will  be  ca  led  Acliu\iiiii  nis  if  m 
diagram  (8)  the  following  equality  holds:  K  =  K  . 

,\n  operation  T  on  the  Transformational  Structure  1S(K)  of  an  input  kern  , I  sentence  K  will  be 

>i< 

called  a  Transformation  if  in  diagram  (’j)  the  following  inequality  holds:  k  K  .  In  this  paper  we 
will  use  the  notation  T(K)  to  refer  to  (lie  English  word  string  that  corresponds  to  the  result  of  the 
action  of  the  transformation  T  on  TS(K). 

According  to  these  definitions,  such  operations  as  Passive,  Question.  There  Insertion.'^  etc.  are 
Transformations  because  they  alter  the  original  sentence.  For  example,  as  the  result  of  successive 
application  of  these  transformations  the  sentence  "Ivan  ate  a  carrot"  will  be  transformed  into 
"A  carrot  was  eaten  by  Ivan".  "Was  a  carrot  eaten  by  Ivan"  and  then  to  "Was  there  a  carrot  eaten 
by  Ivan."  The  transformations  are  part  of  a  planning  vocabulary,  that  is.  each  of  them  must  be 
listed  in  the  input  TASK. 

On  the  other  hand,  the  obligatory  operations  like  AJ/ix  Hopping.  Do  Deletion.  N't  Hopping,  etc. 
together  constitute  the  clean-up  Adjustments'^  of  the  Transformational  Structure  whose  goal  is  to 
obtain  the  'xessary  English  output  after  all  the  transformations  have  been  applied.  They  never 
appear  in  the  input  TASK.  If  the  set  of  transformations  {T}  is  empty,  the  original  kernel  sentence 
K  will  not  be  altered. 

Adjustments  are  meaning-preserving,  purely  syntactical  operations  on  the  Transformational 
Structure.  Transformations,  on  the  contrary,  can  affect  the  meaning  (or  emphtisis)  of  a  kernel 
sentence.  In  fact,  the  meaning  of  a  sentence  obtained  after  combining  several  kernels  altered  by 
transformations  is  built  with  the  help  of  these  transformations.  In  that  sense,  one  can  consider 
Transformations  ;ls  semantic  (meaning-altering)  operations  on  the  Transformational  Structure. 
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§  4.  Commutativity 
Definitions: 

ihmain  of  Definilion  i2t T)  of  a  transformation  T  is  the  set  of  all  sonlcnt  es  K  siirh  that  l(K)i.sa 
g  ammatical  sentence.  The  fact  that  the  sentence  K  belongs  to  the  domain  of  definition  of  the 
t  ansformation  T  is  e.xpressed  in  the  following  way;  K  C  S2(T). 

I  wo  transfornuitions  atid  T,  ate  comnmtative  with  respect  to  a  set  of  kernel  phrase  markers  H  if 
for  each  phrase  marker  K  C  M  the  follow  ing  relations  hold: 

KC12(r,),  KCi2(9,  r,(K)C12(t^),  r,(K)C12(T,1  (9) 

and 

T,(T^(K))=  l/r,(K))  (10) 

111  other  words,  the  transformations  and  are  commutative  if  the  equality  (10)  holds  for  the 
corresponding  domains  of  definition  of  Tj  and  T^. 

As  an  example,  let  us  consider  again  the  sentence  K  =  "Ivan  ate  a  carrot.”  liie  commutativity  of 
fie  transformations  Tj,  =  Passive  and  =  Question  can  be  checked  for  thi'  sentence  because  all 
the  four  outputs  are  grammatical  and  T|,(T^(K))  =  T^(T^(K)).  i.e.  we  have  the  following 
commutative  diagram  (ll): 


K  =  Ivan  ate  a  carrot 


Passive  | 


Question 

. >  IqCK)  =  Did  Ivan  cat  a  carrot 


I /*(7.w/ve  (11) 


X 

f|,(K)  =  A  carrot  was  eaten  by  Ivan 


Question  I 

. >  I'ljCr^^lK))  =  Was  a  carrot  eaten  by  Ivan 


Considering  another  pair  of  transfomiations:  T^.  =  Passive  and  T.j,|  =  There  Insertion  shows  that 
the  commutativity  of  the  transformations  Tj,  and  T.|,|  cannot  be  checked  for  the  sentence  K  = 
"Ivan  ate  a  carrot."  The  transformations  can  be  applied  in  the  order:  1.  Passive.  2.  There  Insertion, 
resulting  in; 
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I'lXK)  =  A  carrot  was  eaten  by  Ivan. 
r|  j(T|^(K))  =  There  was  a  carrot  eaten  by  Ivan. 

But  it  is  not  possible  to  apply  the  transformations  T|,  and  in  the  reverse  order  because  the 
sentence  K  does  not  contain  the  verb  b  ‘.  which  is  necessary  for  There  Insertion  to  work.  I  his  docs 
not  mean,  however,  that  the  two  transfe  rmations;  Tussive  aod  There  Insertion  are  not.  or  cannot  be 
made,  commutative.  The  previous  example  docs  not  contradict  our  dellnition  of  commutativity 
because  the  sentence  K  in  this  example  does  not  belong  to  the  domain  of  definition  of  the  There 
Insertion  transformation. 

/A  similar  problem  arises  with  the  sentence:  K  =  "A  boy  was  eating  the  cake."  Here  it  is  possible  to 
apply  either  T^  =  Passive. 

Tj,(K)  =  The  cake  was  being  eaten  by  a  boy 

or  3  =  There  Insertion: 

Tj  |(K)  =  Tliere  was  a  boy  eating  the  cake 

But  we  cannot  apply  There  Insertion  after  Passive,  nor  can  we  apply  after  There  Insertion.  In 

both  cases  the  result  will  be  unacceptable^*’  because  the  noun  phrase  the  cake  is  definite,  but  There 
Insertion  is  restricted  to  sentences  with  an  indefinite  first  noun  phrase: 

*  There  was  the  cake  being  eaten  by  a  boy 

I  he  following  diagram  (12)  illustrates  this  example; 

There  Insertion 

K  =  A  boy  was  eating  the  cake  . >  f^,(K)  “  llicrc  was  a  boy  eating  the  cake 


Passive 


Passive  (12) 


-I  There  Insertion  4 

I  i^(K)  =  fhc  cake  was  being  eaten  by  a  boy  . >  *  I  herc  was  the  cake  being  oaten  by  a  boy 

20.  ibe  asterisk  *  before  a  sentence  indicates  that  the  sentence  is  "unacceptable",  or  ungrammatical. 
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Again,  as  in  (ho  pre\ioiis  oxaniplo.  (he  lact  dial  we  can  apply  IxXli  and  U)  (he  sentence  K.  but 
taiimn  apply  I'l,  to  I  or  li,  lo  I  |,(K).  does  not  mean  dial  ihere  is  no  coninniiativiiy  in  die 
system,  it  means  only  that  in  this  case  (he  sentence  K  is  irrelevant  to  die  qiies.’ion  of  comnmtativ  ity 
because  K  does  not  satisfy  the  conditions  (9)  specilled  in  the  dellnilion  of  c(  inimitativity;  K  does 
iK)i  belong  to  the  set  of  kernel  phrase  markers  K  with  respect  to  which  comnui  ativity  was  defined. 

One  of  the  requirements  that  we  impose  upon  the  system  is  the  posMbility  to  apply  the 
transformations  in  any  order  (equality  (10)).  Once  this  is  done,  the  domain  membership  (conditions 
(9))  becomes  crucial:  all  the  sentences  obtained  at  each  step  of  the  transform  ition  derivation  must 
be  grammatical. 

Definition: 

N  transformations  Tj  ...  T^  arc  commutative  with  respect  to  a  set  of  kern 1 1  phrase  markers  K  if 
for  any  i  and  j  the  two  transformations  f.  and  I'  are  commutative  with  respect  to  the  set  S  and  if  for 
any  m  <  N  the  result  of  application  of  any  composition  of  m  different  transformations  I'  T  ...  T 
to  a  sentence  K  C  H:  T  (T  ...  (T  (K))...)  is  a  grammatical  sentence. 

'l  '2  'm 

In  this  paper  we  will  build  a  system  of  Commutative  Transformations  that  will  permit  us  to  "solve" 
(he  TASK  given  by  Step  One  and  Step  1  wo  of  the  Language  Generation  Prixedurc  and  lo  generate 
corresponding  English  text.  I  he  commutativity  of  the  system  gives  more  llcxibilily  to  the  first  two 
steps  of  the  LGP.  The  decisions  of  how  to  separate  the  input  semantic  representation  into  groups  of 
kernel  phrase  markers  and  which  of  the  transformations  to  apply  will  not  depend  on  the  order  of 
the  transformations.  It  will  be  based  only  on  the  domain  of  definition  of  each  particular 
transformation  and  on  the  meaning  that  this  transformation  adds  to  the  meaning  of  the  generated 
sentence. 

§5.  Adjustments 

This  section  will  examine  the  clean-up  Adjustments,  operations  which  further  alter  the 
fransformational  Structure  after  all  the  transformations  have  been  applied,  in  order  to  obtain  the 
correct  English  output.  We  will  start  with  an  example.  Consider  the  following  kernel  sentence 
=  "Ivan  was  eating  poU.U'es."  Ihe  Transformational  Structure  'lS(K|j)  for  the  kernel  is 
shown  in  (13): 
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((COMP  comp)  (NPj  (Ivan)) 

(TI-NSK  past)  (INFl.  iiiH)  (AUXl  be)  (NKGl  ncgl)  (NKG2  ncg2)  (Al  I  IXl  ing)  (13) 
(AUX2  nil)  (AFFIX2  nil)  (AUX3  nil)  (AFF1X3  nil)  (VKR»  cat) 

(NPj  (potatoes))) 

Siipposc  that  the  program  CRN  gets  as  input  the  following  TASK: 

TASK  =  (  (K^  ((VV  Question)  ( . ) ) 

Fere,  N2  is  the  notation  for  the  contracted  form  of  the  negative  transformat  on.  It  simply  inserts 
n  't,  the  contracted  form  of  not,  as  the  'alue  of  the  element  NEGl  of  the  TS.  K^).  Question  is  the 
name  of  the  question  transformation.  This  transformation  Urkes  the  thrcj  elements:  TFNSR. 
AUXl  and  NEGl  in  the  Transformational  Structure  of  a  kernel  sentence  and  moves  them  to  the 
front  of  the  structure. 

IS  (Kq),  the  altered  Transformation  Structure  of  TS(Kq)  after  undergoing  these  two 
transformations,  is  shown  below  in  (14): 

((lENSE  past)  (AUXl  be)  (NEGl  n’t)  (COMP  comp)  (NP^  (Ivan)) 

(INFL  inn)  (NEG2  neg2)  (AFFIXl  ing)  (14) 

(AUX2  nil)  (AFFIX2  nil)  (AUX3  nil)  (AFFIX3  nil)  (VERB  eat) 

(NPj  (potatoes))) 

Now  that  all  the  transformations  have  been  applied  to  TS(Kjj)  let  us  consider  how  certain 
Adjustments  work  on  the  resulting  Transformational  Structure  (14). 

(a)  Garbaee  Deletion  removes  all  the  elements  in  the  TS  which  have  been  left  unspecified  at  this 
point.  It  also  rejects  all  elements  whose  value  is  nil.  Ilie  result  is: 

((TENSE  past)  (AUXl  be)  (NEGl  n’t)  (NP,  (Ivan)) 

(AFFIXl  ing)  (VERB  cat)  (NP^  (potatoes))) 

(b)  Do  Deletion  deletes  the  auxiliary  do  when  it  immediately  precedes  a  verb.  But  the 
I  ransformational  Structure  is  designed  in  such  a  way  that  the  auxiliary  do  is  inserted  in  the  I  S  iis  a 
value  of  the  AUXl  only  when  the  original  kernel  sentence  docs  not  contain  any  other  auxiliary 
verbs.  I  here  is  no  do  in  the  Structure  (14)  since  the  auxiliary  be  is  present,  therefore  the  adjustment 
Do  Deletion  is  not  applicable  in  this  example. 

(e)  Affix  Itoopinn  takes  every  affix  that  is  immediately  followed  by  a  verb  (including  l  ENSE.  which 
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a%  mentioned  in  Section  1  also  carries  the  grammatical  reatiires  of  NPj)  and  attaches  it  to  the  verb  so 
that  the  afllx  becomes  part  of  it: 

((AUXl  was)  (NF.Gl  n’t)  (NP,  (Ivan)) 

(VFRIi  eating)  (NP,  (potatoes))) 

(d)  Hoppim;  takes  the  element  NKCil  of  the  I  ransformational  Structure  and  attaches  its  value 
n't  to  the  immediately  preceding  auxilia'y  verb. 

((AUXl  wasn't)  (NPj  (Ivan))  (15) 

(VERB  eating)  (NP^  (potatoes))) 

^'o\v  that  all  the  adjustments  have  beei  performed,  the  word  string  composed  of  the  values  of  all 

the  constituents  of  the  Transformalioaal  Structure  (15)  produces  the  correct  kernel  sentence 
♦ 

Kjj  =  "Wasn't  Ivan  eating  potatoes": 

Thus,  we  have  examined  the  following  four  Adjustments'?^ 

1.  Garbage  Deletion 

2.  Do  Deletion  (16) 

3.  Affix  Hopping 

4.  N't  Hopping 

We  are  going  to  show  now  that  in  order  to  build  a  system  of  Commutative  transformations  the 
following  two  constraints  must  be  imposed: 

Separation  Constraint:  Any  adjustment  in  the  list  (16)  should  be  executed  only  after  all  the 
transformations  from  the  TASK  have  been  applied. 

Ordering  Constraint:  The  adjustments  must  be  applied  only  in  the  order  in  which  they  are 
listed  in  (16). 

First,  in  order  to  prove  the  necessity  of  the  Separation  Constraint  we  need  to  show  that  none  of  the 
adjustments  can  be  performed  before  a  transformation.  This  can  be  shown  by  contradiction:  we 
will  demonstrate  for  each  of  the  adjustments  in  (16)  that  the  violation  of  the  Separation  Constraint 
prevents  the  application  of  certain  transfomiations  or  leads  to  an  infraction  of  commutativity. 


21 .  Ill  ihc  impicmcnicd  system  there  :irc  :i  few  oilier  iidjuslments.  but  for  simplicity  we  will  not  discuss  them  here. 
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Finding  one  counterexample  to  eveiy  adjustment  is  sufficient  for  a  piix)l  because  of  the 
Commuuiiivily  of  die  system.  For  clarity,  we  will  consider  the  arguments  in  connection  with  either 
the  kernel  sentence  "Ivan  ate  the  carrot"  and  its  corresponding  Transformational  Structure  (17): 

((COMP  comp)  (NP|  (Ivan)) 

(TENSR  past)  (INFl.  infi)  (AUXl  do)  (NEGl  negl)  (NI:G2  neg2)  (VI  lUl  cat)  (17) 
(NP^  (the  carrot))) 

or  with  the  kernel  sentence  "Ivan  was  eating  the  carrot"  and  its  Transformational  Structure  (18): 
((COMP  comp)  (NPj  (Ivan)) 

(TENSE  past)  (INFL  infi)  (AUXl  be)  (NEGl  negl)  (NEG2  neg2)  (Al  l  1X1  ing)  (18) 
(VERB  cat) 

(NPj  (the  carrot))) 

1.  Garkise  Deletion  cannot  be  performed  before  any  transformation  that  uses  the  dummy  elements 
in  the  Transformational  Structure;  for  instance.  Negation,  or  any  transformation  that  constructs 
embedded  clauses.  This  is  because  the  elements  required  by  such  transformations  would  be  deleted 
by  the  Garbage  Deletion  adjustment  before  these  transformations  could  have  been  applied. 

2.  Do  Deletion  cannot  be  performed  before  the  Question  transformation.  If  it  were,  the  auxiliary 
verb  do  which  is  necessary  for  the  construction  of  the  correct  output  of  the  Question  transformation. 
"Did  Ivan  eat  the  carrot",  will  be  prematurely  deleted  by  the  adjustment  Do  Deletion. 

3.  AfCix  Hoppim  cannot  be  performed  before  any  transformation  that  inserts  a  new  verb  or  a  new 
affix  into  the  Transformational  Structure.  Suppose  that  the  transformation  Passive  is  to  be  applied 
to  the  Transformational  Structure  (18)  of  the  kernel  sentence  "Ivan  was  eating  the  carrot."  Among 
other  effects  this  transformaiion  inserts  the  verb  l2e  with  the  affix  gn  in  front  of  the  main  verb  ea( 
into  the  1  ransformational  Structure  (18)  in  order  to  obtain  the  past  participle  of  the  verb.” 

((COMP  comp)  (NP,  (The  carrot)) 

(TENSE  p;»st)  (INFL  infi)  (AUXl  be)  (NF.Gl  negl)  (NEG2  ncg2)  (AFI  IXI  ing) 
(BE-PASS  be)  (EN-PASS  en)  (VERB  cat) 

(BY-PASS  by)  (NP^  (Ivan))) 

If  the  adjustment  Affix  Hopping  had  been  applied  to  the  Transformational  Structure  (18)  before  the 


22.  t  he  dcbcripiion  of  the  Passive  iransfomiation  can  be  found  in  Section  7. 
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Passive  iransformalion.  the  afllx  mg  would  "hop"  onto  ihe  wrong  verb  cat  ii'sicad  of  the  verb  tic. 
I  he  alTix  gn.  inserted  aficrvvards  by  tlic  Passive  iransrormaliun.  could  not  "liop"  on  the  verb  eat.  As 
a  result,  the  system  would  not  be  able  to  output  the  expected  sentence  "  Ihe  carrot  was  being  eaten 
by  Ivan." 

4  Ihe  avljusiinent  ^  tfopp/ng  also  cannot  precede  certain  iransl'ormations.  l  et  us  consider  the 

♦ 

I  ranslbrmational  Structure  I S  for  the  sentence  "Ivan  ate  the  carrot"  after  the  two  transrormations 
(  uesiion  and  N't  have  been  applied; 

UrtNSK  past)  (AUXl  do)  (NKGl  nt)  (COMP  comp)  (NP,  (Ivan)) 

(INf  1.  inO)  (Nt;G2  neg2)  (VE'^B  eat) 

(NP,  (the  carrot))) 

If  the  adjustment  N't  Hopping  is  now  applied  before  Ihe  transformation  Passive,  the  element  iO  will 
be  prematurely  attached  to  the  auxiliary  verb  do.  As  a  result,  it  will  be  impossible  to  execute  the 
transformation  Passive  and  transfonn  the  sentence  "Didn’t  Ivan  eat  the  canot"  into  the  sentence 
"Wasn't  the  carrot  eaten  by  Ivan." 

We  have  shown  that  the  adjustments  are  separated  from  the  transformations.  Now.  to  demonstrate 
that  the  Ordering  Constraint  is  needed,  we  will  again  examine  the  sentence  "Ivan  ate  the  carrot"  and 
its  I  ransformational  Structure  (17).  We  need  to  show  that  the  adjustments  must  necessarily  be 
ordered  as  staled  in  (16);  1.  Garbage  Deletion,  2.  Do  Deletion,  3.  Affix  Hopping,  4.  N't  Hopping. 

1.  Garbage  Deletion  differs  from  the  other  three  adjustments  in  (16)  because  it  does  not  employ  the 
notion  of  adjacency  required  by  all  the  other  adjustments;  Do  Deletion  deletes  the  auxiliary  do 
when  it  immediately  precedes  a  verb;  Ajjtx  Hopping  attaches  the  affix  to  the  verb  immediately  to  ite 
right;  N't  Hopping  attaches  n't  to  the  immediately  preceding  auxiliary  verb. 

Prior  to  the  adjustment  Garbage  Deletion,  the  adjacency  condition  necessary  for  the  application  of 
the  other  adjustments  does  not  hold  because  of  the  presence  of  unspecified  elements  in  the 
'I  ransformational  Structure.  Garbage  Deletion  should  be  executed  first  because  it  eliminates  these 
unspecified  elements  allowing  the  other  adjustments  to  work.  For  example.  Garbage  Deletion 
removes  the  unspecified  elements  NEGl  and  NEG2  in  the  Transformational  Structure  shown 
below,  making  it  possible  for  Do  Deletion  to  delete  Ute  auxiliary  do  since  do  and  the  main  verb  are 
now  adjacent: 
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((NP,  (Ivan)) 

(TKNSL  pasl)  (AUXl  do)  (VKRB  cat) 

(NPj  (the  carrot))) 

It  should  also  be  noted  that  the  adjustments  Do  Deletion,  Affix  Hopping,  and  N't  Hopping  ilo  not 
introduce  any  dummy  or  unspecified  elements  in  the  IS  which  would  othciwisc  have  to  be 
removed  by  the  Garbage  Deletion. 

2.  Do  Deletion  must  be  performed  before  Affix  Hopping.  Otherwise,  the  value  past  of  the  I  HNSI: 
would  "hop"  onto  the  verb  do  instead  of  eat,  and  after  executing  all  the  adjustments  on  the 
1  ransformational  Structure  (17)  we  would  obtain  the  sentence  "ivan  did  eat  vhc  carrot"  instead  of 
"Ivan  ate  the  carroL"^^ 

3.  The  adjustment  Affix  Hopping  cannot  follow  N’t  Hopping.  To  show  this  suppose  that  the 
transformation  N't  has  been  applied  to  the  Transformational  Structure  (17).  After  the  Garbage 
Deletion  adjustment  the  TS  will  have  the  following  form; 

((NP,  (Ivan)) 

(I  RNSK  past)  (AUXl  do)  (NEGl  n’t)  (VERB  eat) 

(NPj  (the  carrot))) 

If  now  the  adjustment  N’t  Hopping  is  executed  first,  producing  the  new  element  don’t,  the  Affix 
Hopping  adjustment  will  not  be  able  to  attach  the  TENSE  to  the  element  don’t.  I'his  observation 
completes  the  proof  of  the  Ordering  Constraint. 

F  hus  two  different  classes  of  operations  on  the  Transformational  Structure  have  been  defined  in 
this  paper  so  far:  the  optional  commutative  Transformations  and  the  obligatory,  intrinsically 
ordered  Adjustments.  The  Separation  Constraint  and  the  Ordering  Constraint  explain  their  mutual 
relations. 

§6.  Connective  Transformations 

In  this  section  we  will  examine  the  Connective  Transformations,  a  particular  chiss  of  I'nglish 
transformations  which  arc  used  to  construct  sentences  with  Embedded  Clauses.  In  order  to  Ibrm  a 


23.  the  scnicncc  "Ivan  did  eal  the  carrol"  is.  of  course,  fully  grammatical.  It  is  the  emphatic  form  of  ihe  senicnee  "Ivan 
ale  the  carrol"  used  lo  stress  a  ceilain  semaiuic  message.  In  designing  the  system  we  decided  not  to  allow  such  sentences 
so  that  all  the  adjusimenLs  would  be  obligatory. 
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scnicnce  of  this  type  ihe  system  needs  two  kernel  phrase  markers  as  input:  -  v.hicli  plays  the  role 

of  matrix  clause  mk\  -  which  is  used  as  the  basis  for  the  embedded  clause.  The  word  d  will  be 

used  as  a  joining  point.  The  kernel  sentence  must  contain  the  word  it.  in  the  role  of  eithei  agent 

or  theme.  A  Connective  Transformation  when  applied  to  the  kernel  sentence  is  siiid  to  proiluce 
♦ 

the  altered  kernel  in  the  form  appropriate  for  an  embedded  clause.  Other  transformations 

% 

(if  any)  change  the  kernel  into  Then,  a  special  procedure  combines  ihe  two  altered  kernel 

♦  It 

sentences  by  substituting  the  kernel  for  the  joining  point  U  in  the  kernel  K 

As  an  example  of  the  pnxedure  just  dc  cribed,  consider  the  following  kernel  sentences; 

Kjj  =  It  bothers  Maria  (19) 

Kj  =  Ivan  has  ignored  that  letter 

1  he  embedded  clause  has  the  Transformational  Structure  below: 

((COMP  comp)  (NPj  (Ivan)) 

(I't'NSH  present)  (INFI.  infl)  (AUXl  have)  (NHGl  negl)  (NHG2  neg2)  (AFFIXl  cn)  (20) 
(VFkb  ignore)  (NP^  (that  letter))) 

Now  suppose  that  one  of  the  Connective  Transformations,  FOR-NPj-TOj,  is  to  be  applied.  This 
transformation  produces  a ybr-/p-complement  clause  by  inserting  FOR  and  TO  as  the  values  of  the 
elements  COMP  and  INFL,  respectively,  in  the  Transformational  Structure  (20).  The  result  is: 

((COMP  For)  (NPj  (Ivan)) 

(ILNSK  present)  (INFL  to)  (AUXl  have)  (NFGl  ncgl)  (NKG2  ncg2)  (Al'FIXl  cn) 

(VKRIJ  ignore)  (NP^  (that  letter))) 

Then  the  transformed  kernel  sentence  K*  =  "For  Ivan  to  have  ignored  that  letter"  is  substituted 
for  the  word  H  in  the  kernel  =  "It  bothers  Maria"  producing  the  sentence:  "Tor  Ivan  to  have 
ignored  that  letter  bothers  Maria"  as  the  result 

The  Connective  Transformations  form  a  ftimily  of  transformations  defined  by  three  parameters, 
each  referring  to  a  position  in  the  Transformational  Structure  of  the  embedded  clause:  tlie 
complementizer  COMP,  the  first  noun  phrase  NPj  and  the  complementizer  INFL. 

The  parameter  COMP  indicates  the  affix  which  introduces  the  embedded  clause.  It  can  receive  one 
of  the  following  four  values:  jPOSS,  THAT,  FOR,  0}.  The  affix  POSS  actually  "hops"  onto  the 
following  noun  during  the  Affix  Hopping  adjustment  to  form  a  possessive  noun  phrase.  THAT  and 
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I-OR  are  "independent"  words  and  do  not  hop  to  the  right  like  other  affixes.  0  means  that  there  is 
no  overt  affix  in  this  position. 

Tic  parameter  NPj  takes  on  one  of  two  values;  {NP^,  0}  indicating  whether  or  not  the  first  noun 
phrase  of  the  embedded  clause  is  present  in  the  resulting  sentence. 

lie  parameter  INFL  may  also  be  considered  an  affix  specifying  how  the  verb  in  the  embedded 
I  lause  should  be  inflected.  It  can  have  one  of  four  values:  {INC.  INF.  TO.  0}.  As  in  the  case  of 
POSS,  the  value  INC  is  the  only  "real"  affix  which  hops  onto  the  following  verb  producing  the 
progressive  form.  Tlie  value  INF  indicates  that  the  following  verb  is  in  the  infinitive  form.  10  is 
:  n  independent  word  which  produces  .he  TO  -l-  infinitive  form  of  the  verb.  0  signals  that  no  alTix 
is  present,  so  the  verb  remains  inflected  for  person,  number  and  tense. 

/\  partici'iar  set  of  values  for  the  three  parameters  COMP.  NP|,  and  INFL  is  sufficient  to  determine 
tne  form  of  the  embedded  clause  completely  (although  not  every  possible  triple  produces  a 
grammatical  English  clause).  Hence  the  commutative  transformation  which  generates  the 
embedded  clause  is  also  uniquely  determined.  Therefore,  we  will  use  the  values  of  these  three 
parameters  to  form  the  names  for  the  Connective  Transformations.  Each  name  is  represented  as  a 
triple  consisting  of  the  current  values  of  the  parameters  COMP.  NP^  and  IN^'L  with  the  following 
structure:  COMP-NPpINFL.  We  have  already  seen  some  examples  of  such  names:  O-NPj-TO. 
THAT-NPpO,  FOR-NPj-TO,  etc. 

fhe  adjustment  Affix  Hopping  deletes  the  element  TENSE  in  the  Transformational  Sirn.  ture 
unless  the  value  of  the  parameter  INFL  is  0.  Consequently,  most  of  the  Connective 
Transformations  construct  tenseless  clauses.  The  exceptions  are  the  transformations  THA  f-NPpO 
and  O-NPj'O.  To  give  examples  with  tensed  embedded  clauses  let  us  consider  now  another  kernel 
sentence  for  the  matrix  clause:  =  "Maria  knows  iL"  After  combining  the  altered  kernels,  the 

program  outputs  the  following  sentences: 

1.  After  n  JAT-NPj-Oj.'  Maria  knows  that  Ivan  has  ignored  tJiat  letter 

2.  After  O-NP^-Oj:  Maria  knows  Ivan  has  ignored  dial  letter 

I  he  transformations  THAT-NPj  -O  and  O-NP^-O  al.so  differ  from  the  ininsformalions  which 
produce  tenseless  clauses  in  their  treatment  of  negative  elements  in  the  fransformational  Siruclure. 

A  general  description  of  the  action  of  a  Connective  Transformation  can  be  stated  as  follows: 

(a)  Current  values  of  the  parameters  COMP  and  INFL  from  the  name  of  the  transformation 
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arc  inserted  in  the  I  ranslbrinatio.uil  Structure. 

(b)  If  the  value  of  the  parameter  isO.  the  element  NP^  is  removed  from  the  Siructure. 

(c)  If  the  value  of  INKl.  is  not  0.  two  negative  elements.  NHGl  and  NEG2.  are  moved  from 
their  usual  position  after  the  first  auxiliary  verb  and  placed  in  the  front  of  I  HNSH.  We  will 
call  this  phenomenon  NegJump. 

When  the  value  of  the  parameter  NP^  is  0.  the  first  noun  phnise  in  the  matrix  clause  must  be 
coreferential  with  the  first  noun  phrase  in  the  embedded  clause.  As  an  example,  consider  the  pair 
of  kernel  sentences: 


Kg  =  Ivan  wanted  it 
K|  -  Ivan  kissed  Maria 

Suppose  that  the  transformation  O-O-TO  applies.  This  transformation  inserts  the  required  values  of 
COMP  and  INFL  into  the  fransformotional  Structure  for  the  kernel  sentence  Kj  and  deletes  the 
element  NP^  in  the  Structure: 

((COMP  0)  (NP,  0)  (NEGl  negl)  (NEG2  neg2) 

(TENSE  piist)  (INFL  to)  (AUXl  do) 

(VERB  kiss)  (NP^  (Maria))) 

After  all  the  adjustments  have  been  performed  and  the  altered  kernels  have  been  combined  the 
program  will  output:  "Ivan  wanted  to  kiss  Maria" 

in  the  example  above  Neg  Jump  takes  place  only  vacuously  because  the  unspecified  elements 
NFGl  and  NEG2  are  removed  from  the  Transformational  Structure.  It  is  also  difficult  to  see  this 
phenomenon  if  the  kernel  sentence  Kj  does  not  have  any  auxiliary  verbs  because  after  the  Garbage 
Deletion  adjustment  nothing  will  be  left  in  the  TS  for  NEG  to  jump  over.  This  phenomenon  can  be 
observed  in  a  sentence  in  which  the  negative  transformation  Not  also  applies.  The  following  TASK 
provides  us  with  the  appropriate  examples: 

TASK  =((Kg  Kj)  {That-np^-O^  Not^  For-np^-to^  Poss-np^-ing^)  (.)) 

FIcre  Kg  and  K^  are  the  kernel  sentences  from  (19): 

Kg  =  It  bothers  Maria  (19) 

Kj  =  Ivan  has  ignored  that  letter 

Neg  Jump  can  be  observed  by  comparing  cither  sentences  #1  with  #3  or  sentence"  Jt.  with  #4 
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in  (21): 

1.  After  rHA  l'-NPj-0|:  I  hat  l\aii  has  ignored  iliat  letter  bothers  Maria 

2.  After  NOT^;  I'hai  ban  has  not  ignored  that  letter  bothers  Mai  la  (21) 

3.  After  I  'OR-NIY  I  Oji  I'or  ban  not  to  ha\e  ignored  that  letter  bothers  Maria 

4.  After  I’OSS-NI’j-INGj:  ban's  not  having  ignored  that  letter  bothers  Mana. 

The  system  contains  a  ftimily  of  ten  different  Connective  Tninsfomuiiiuris  tiscd  to  constrtici 
sentences  with  various  embedded  clauses.  An  example  of  the  application  of  each  of  these 
transformations  is  given  in  the  table  below: 

lABI.I-;  1 


Tioitsformalioii 

Matrix  ( lausc 

i'.mbedJed  Clause 

Sentence 

IHAI-NIYO 

It  bothers  Maria 

Ivan  ignored  the  letter 

'I'hat  Ivan  ignored  ihe  letter  bothers  Maria 

IIIAl-NIYIN!' 

Maria  suggests  it 

Ivan  is  silent 

Maria  suggests  that  Ivan  be  silent 

O-NIYINF 

Maria  watched  it 

Ivan  washed  the  dishes 

Maria  watched  Ivan  wash  the  dishes 

o-Niyo 

Maria  knows  it 

Ivan  has  ignored  that  letter 

Maria  knows  Ivan  has  ignored  that  letter 

I'OK-NIYIO 

It  amuses  Maria 

Ivan  ignored  the  letter 

Lor  Ivan  to  ignore  the  letter  amuses  Maria 

()-NIYfO 

Maria  asked  it 

Ivan  ate  the  cake 

Maria  asked  Ivan  to  eat  the  cake 

0-0-10 

Ivan  elaims  it 

Ivan  has  written  that  letter 

Ivan  claims  to  have  written  that  letter 

POSS-NFi-ING 

It  siKKked  Maria 

Ivan  ignored  the  letter 

Ivan's  ignoring  the  letter  shocked  Maria 

O-NI’j-ING 

Maria  saw  it 

Ivan  ate  the  cake 

Maria  saw  ban  c.iting  the  cake 

0-0- ING 

It  amuses  Maria 

Maria  watches  movies 

Watching  movies  amuses  Maria 

I  hc  main  verb  of  the  matrix  cltitise  determines  which  clause  may  be  embedded  under  it  and, 
therefore,  the  kind  of  Connective  Transformation  that  may  be  applied  in  each  ptirticular  case. 
ConsL't|tientiy.  titiy  computer  itnplementation  of  the  Language  Generation  Procedure  must  contain 
;i  list  of  permissible  transformations  for  every  verb  that  can  appear  in  a  matrix  clause. 

Ihe  system  prevents  the  generation  of  the  ill-formed  sentences  by  employing  transformational 
filters,  a  third  class  of  operations  on  the  fransformational  Structure,  which  not  only  signal  that  a 
certain  combination  of  the  transformations  will  result  in  an  ungrammatical  sentence,  but  also,  if 
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possible,  suggest  iiddilioiial  rules  in  order  to  correct  the  oiiipui.-'  Although  this  paper  will  not 
considei  such  rules  in  detail,  here  are  several  illustrative  examples: 

(.i)  If  the  transformations  rHAr-NPpOj  and  PASSIVE  have  been  applied  to  kernel  sentenees 
and  Kj  from  (19),  the  resulting  sentence  obtained  after  combining  the  altered  kernels  is  ill-fomied; 
*  "Maria  is  bothered  by  that  Ivan  hits  ignored  that  letter."  The  transformational  filter  rejects  the 
i  ngrammatical  construction  prep-THAT-clause  i\m\  suggests  thiit  the  words  "the  fact"  be  inserted 
i  t  the  Transformational  Structure  of  the  embedded  clause.  Then,  after  all  the  Acljusi/nenis  have 
been  applied,  the  system  outputs  the  correct  sentence:  "Maria  is  bothered  by  the  fact  that  Ivan  has 
ignored  that  letter."” 

(b)  If  the  transformations  O-NP-TOj  and  PASSIVE  are  to  be  performed  on  the  kernels  - 

"Maria  forced  it"  and  =  "Ivan  peeled  potatoes",  the  program  htis  to  combine  the  altered  kernel 

*  * 
l,(j  =  "It  wiis  forced  by  Maria"  with  the  altered  kernel  =  "Ivan  to  peel  potatoes,"  The 

transformational  filter  rejects  the  resulting  sentence:  *  "Ivan  to  peel  potatoes  w;is  forced  by  Maria" 

r.s  ungrammatical.  Then,  Uiking  into  account  the  semantic  class  of  the  main  verb  force,  the  filter 

proposes  to  "niisc"  the  first  noun  phrase  of  the  embedded  clause  Ivan  to  the  position  of  the  first 

noun  phrase  in  the  matrix  clause  //;  the  rest  of  the  embedded  clause  moves  to  the  end  of  the  matrix 

clause.  Now  the  resulting  sentence  is  correct:  "Ivan  was  forced  by  Maria  to  peel  potatoes." 

(c)  If  the  embedded  clause  is  very  long,  the  transformational  filter  suggests  applying  the 
Extraposition  rule,  a  rule  which  shifts  the  embedded  clause  to  the  end  of  the  matrix  clause  leaving 
the  word  "it"  in  its  original  position  in  the  matrix  clause.  Thus,  the  sentence  HI  from  (21)  can  be 
changed  to  "It  bothers  Maria  that  Ivan  has  ignored  that  letter."” 

A  family  of  ten  transformations  for  generating  embedded  clauses  was  introduced  in  this  section, 
fhis  family  is  completely  defined  by  the  values  of  three  parameters  COMP,  NP^,  and  INFL  and, 
therefore,  can  be  considered  as  a  single  Connective  Transformation  whose  surface  manifestation  has 
several  different  fonns  depending  on  the  values  of  these  parameters. 


24.  In  conirasl  with  ihe  usual  iransformalions.  which  operate  within  a  kernel  sentence,  one  can  analyze  inmsfomaiional 
fillers  as  interkernel  iransformalions  because  they  may  operate  across  the  kernels. 

25.  The  noun  "fact"  is  one  of  the  so-called  /active  nouns  which  include  also  words  like  "idea",  "report",  etc. 

2^1  We  leave  aside  for  now  the  question  of  defining  "length".  Notice,  that  the  Exiraposiiion  rule  may  also  apply  to  short 
embedded  clauses:  "It  bothers  Maria  that  Ivan  left." 
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§7.  Other  I  ransformations 

In  this  section  we  will  add  three  new  iransforniations  to  the  system  of  ('ommuuiiiw 
Transformations'.  Tj,  =  Passive.  =  Dative  Movement,  and  I  n  -  There  Insertion.  Ihe 
definitions  of  these  transformations  refer  to  the  noun  phrase  positions  in  the  I  ransformaliotial 
Structure;  NP^.  NP^  NP^.  and  to  their  lexical  and  semantic  values. 

Definition: 

t\issive  is  a  transformation  that 

(a)  Permutes  to  the  left  the  values  of  three  noun  phr;iscs  NP^.  NP^  and  NP^ 

.  > 

r  i 

NP  < . NP,^< . NP, 

(b)  Inserts  the  verb  be  after  the  affix  of  the  last  auxiliary  verb  or.  if  AUXl  -  do.  sid^stitiites 
ilie  verb  be  f)r  the  auxiliary  do 

(c)  Inserts  the  affix  ea  in  front  of  the  main  verb 

(d)  Inserts  the  preposition  by  in  front  of  NP^” 

Consider  the  kernel  sentence  K  =  "Ivan  gave  Maria  the  bottle"  with  the  fransformational 
Structure  (22): 

((COMP  comp)  (NPj  (Ivan)) 

(II  NSH  past)  (INI-I.  inll)  (AUXl  do)  (NHGl  negl)  (NI;G2  ncg2)  (22) 

(VI  KIJ  give)  (NPj^  (Maria))  (NPj  (the  bottle))) 

Ihe  Passive  transformation  alters  the  kernel  sentence  K  =  "Ivan  gave  Maria  the  bottle"  into  the 
seiUenee  l'|,(K)  =  "Maria  was  given  the  bottle  by  Ivan"  b)  ch.inging  the  fransformational 
Slrueture  (22)  into; 

((COMP  comp)  (NP,  (Maria)) 

(ll'.NSi:  past)  (INI-I.  inll)  (AUXl  he)  (NfGl  negl)  (Nr.(i2  neg2)  (2.1) 

(|;N  PASS  en)  (VLKIj  give)  (NP,^  (Ihe  bottle))  (15V  PASS  by)  (NP,  (Ivan))) 


?J.  In  ilii'  (Icriniliciii.  when  icloiiii^'  lo  lliv  wdkIs  hr.  cn.  and  hywv  iiu'an  clciiunis  (HI-PASS  bo),  (IN  P.ASS  on),  ,iiut 
(HV-PASS  l>>)  in  ihc  I  ranstoriiindonal  Sdutdiie. 
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Im  ilic  case  when  llieie  are  onl.\  iwo  noun  phrases  in  ihe  input  kernel  senieiiee.  to  peiimiie 
NP's  means  the  same  as  to  inierehanue  them.  In  this  ease  our  definition  eomes  i  loser  to  the 
eoinentional  definition  of  Passive. 

I  he  transformation  Dative  Movement  changes  the  kernel  sentence  K  ^  ":van  gave  Maria  the 
bottle"  into  tlie  sentence  I  -  "Ivan  gave  the  Untie  to  Maria."  A  possihlj  definition  Dative 

Movement  could  refer  to  the  syntactic  constiiuenis  and  Nl\  in  tie  I  ransformational 

Structure: 

(a)  Interchange  the  values  of  NP^  ^  and  NP^ 

(b)  Insert  the  word  to  in  front  of  NP, 

I  his  definition  of  Dative  Movement  when  applied  U)  the  kernel  K  gives  the  dt  sired  result  l  ^fK)  - 
"Ivan  gave  the  bottle  to  Maria."  Suppose,  however,  that  the  Passive  transform  uion  is  to  be  applied 
to  the  kernel  K  prior  to  Dative  Movement  producing  the  fransformational  Structure  (23) 
corresponding  to  the  sentence  =  "Maria  wjis  given  the  bottle  by  Ivan."  If  Dative  Movement 
(as  it  is  defined  above)  is  now  applied  to  I'^fK).  the  Iransformational  Structure  will  be  transformed 
into: 

((COMP  c(;mp)  (NPj  (Maria)) 

n  I  NSK  past)  (INFL  inll)  (AUXl  be)  (NEGl  negl)  (NF.G2  neg2) 

(FN-PASS  en)  (VERB  give)  (NP,j  (Ivan))  (BY-PASS  by)  (DAT  to)  (NP^  (the  bottle))) 

I  he  resulting  sentence  1  is  unacceptable:  *  "Maria  was  given  Ivan  by  to  the  bottle." 

In  order  to  obtain  the  correct  result  we  need  a  difTerent  definition  of  Dative  Movement  which  refers 
not  to  NP-positions  in  the  Iransformational  Structure,  but  rather  to  semantic  values  of  the  noun 
phrases  which  indicate  the  role  that  the  noun  phrase  plays  in  the  sentence:  agent,  goal,  or  theme. 

In  this  paper  several  transformations  which  operate  on  the  Transformational  Structure  of  a  kernel 
phrase  marker  have  been  examined:  the  Question  Transformation.  Negation  (full  and  contracted), 
Passive,  and  the  Connective  Transformation.  All  of  these  transformations  arc  defined  in  purely 
syntactical  terms:  they  move,  itiscrt.  or  delete  syntactic  constituents  in  the  Iransformational 
Structure.  So  far,  we  have  seen  semantic  notions  used  only  in  the  "decision-making"  procedures, 
f  ivr  instance,  the  system  needs  the  semantic  class  of  the  main  verb  in  the  matrix  clause  to  detemiine 
which  of  the  Connective  Transformations  may  be  applied  and  what  rule  should  combine  the  altered 
kernel  sentences. 
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Dative  Movement  is  the  only  transfornialion  in  our  system  that  is  cleHiicci  in  seinamical  terms. 
Definition: 

Dative  Movement  is  a  transformation  that 

(a)  Interchanges  the  noun  phrase  which  plays  the  role  of  goal  with  the  noun  phrase  whicli 
plays  the  role  of  theme 

(b)  Depending  on  the  main  verb,  assigns  one  of  two  values  j  TO.  FOR}  to  the  element  D.M' 
which  will  later  be  inserted  in  front  of  the  goal  noun  phrase  in  the  I  S  bj  a  special  adjustment 
DAT  Insertion 

Ihe  result  of  this  transformation  is  that  the  goal  noun  phrase  will  be  in  th ;  position  previously 
oxupied  by  theme  noun  phrase  and  the  theme  NP  will  be  in  the  position  occupied  by  goal  NP. 

For  instance,  the  Dative  Movement  transforms  the  Transformational  Structure  (22)  of  the  kernel 
sentence  K  =  "Ivan  gave  Maria  the  bottle"  into: 

((COMP  comp)  (NPj  (Ivan)) 

(TENSE  past)  (INEE  infi)  (AUXl  do)  (NEGl  ncgl)  (NEG2  ncg2)  (24) 

(VERB  give)  (NP^^  (the bottle))  (NP^  (Maria))) 

I  hen  the  adjustment  DAT  Insertion  inserts  the  clement  (DAT  to)  into  the  Transformaliontil 
Structure  (24)  resulting  in  (25): 

((COMP  comp)  (NP,  (Ivan)) 

(TENSE  past)  (INEE  infi)  (AUXl  do)  (NHGl  ncgl)  (NEG2  neg2)  (25) 

(VERB  give)  (NP,^  (the  bottle))  (DAT  to)  (NP^  (Maria))) 

After  all  the  other  adjustments  have  been  perfomicd  Ihe  system  outputs  the  correct  sentence  "Ivan 
gave  the  bottle  to  Maria."^ 

Not  only  do  we  obtain  the  correct  results  by  applying  each  of  two  transformations  Passive  and 
Dative  Movement  to  the  I  S  of  the  kernel  sentence,  but  also,  our  dclinilions  are  so  formulated  that 
these  transformations  can  he  applied  in  any  order.  Dative  Movement  can  be  applied  to  the 
I  ransformational  Structure  altered  by  Passive  vice  versa. 
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I  el  us.  lor  example,  apply  Dative  Movement  to  the  I  S  in  (2})  altered  by  the  Passive  iiaiisrormaiion. 
I  he  noun  phra.se  "Maria"  which  jrlays  the  role  of  goal  is  interchanged  with  the  noun  phrase  "the 
br)ttle"  which  plays  the  role  o\'  theme,  i  hcn.  the  DAT  Insertion  adjustment  inserts  the  preposition 
to  in  front  of  the  goal  noun  phrase  "Maiia"  producing  the  IS  (26): 

((COMP  comp)  (NP|  (the  bottle*) 

(  rENSK  past)  (INEL  ind)  (AUXl  be)  (NEC I  negl)  (NEU2  neg2)  (26) 

(EN-PASS  en)  (VERII  give)  (DM  to)  (NP,^  (Maria))  (BY-PASS  by)  (NP^  (Ivan))) 

I  le  resulting  sentence  is  Ti);^,(l p(K))  =  "Ihe  bottle  was  given  to  Maria  by  Ivan."  I  he 
I  ansformational  Structure  (26)  can  also  be  obuiined  if  the  transformation  Passive  is  applied  to  the 
I S  (24)  (that  is.  after  Dative  Movement  has  been  applied). 

I  he  follow  ing  diagram  (27)  illustrates  th:  commutativity  of  these  transformations: 


K  =  ban  gave  Maria  the  bottle 


Dative  .Movement 

. >  f|)y(R)  =  bii”  die  buttle  to  Maria 


Passive 


Passive  (11) 


Dative  Movement 


4 


r^(K)  =  Maria  was  given  the  buttle  by  Ivan 


>  I  he  buttle  was  gi\en  to  Maria  by  Ivan 


The  final  transformation  to  be  considered  is  There  Insertion,  defined  below. 
Definition: 

There  Insertion  is  a  transformation  that 

(a)  Substitutes  the  word  ther^  for  the  the  NP^-position  in  the  1'S 


29.  More  precisely,  the  element  ( TH  there)  of  the  4  ransformalional  Structure. 
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(b)  Moves  the  NPj-posilion  in  front  of  the  affix  associated  with  the  leftmost  oceurieiKc  of  the 
verb  in  the  fransfomialional  Structure 

As  an  example,  consider  the  kernel  sentence  K  =  "A  boy  was  eatini;  a  cake"  with  the 
I  ransforniaiional  Structure  (28): 

((COMP  comp)  (NP|  (a  boy)) 

(I  HNSP:  past)  (INFL  infi)  (AUXl  be)  (NKGl  ncgl)  (Nt;G2  ncg2)  (Al  l  1X1  ing)  (28) 
(VERB  eat)  (NP^  (a  cake))) 

I  here  is  only  one  verb  be  in  the  TS  above,  therefore,  AFFIX  1  is  the  rcquiicd  affix.  After  applying 
the  iransfornialion  There  Insertion  the  Transformational  Structure  (28)  w  ill  be  transformed  to  (29): 

((COMP  comp)  (I  N  there) 

d'FNSE  past)  (INFL  infi)  (AUXl  be)  (NEGl  ncgl)  (NEG2  neg2)  (29) 

(NP|  (a  boy))  (AFFIXl  ing)  (VERB  cat)  (NP^  (a  cake))) 

The  corresponding  English  output  is  "There  was  a  boy  eating  a  cake." 

Suppose,  however,  that  Passive  was  applied  to  the  Transformational  Structure  (28)  causing  another 
verb  be  to  be  inserted  after  AFFIXl: 

((COMP  comp)  (NP,  (a  cake)) 

(TENSE  past)  (INFI.  inll)  (AUXl  be)  (NEGl  ncgl)  (NEG2  neg2)  (AFFIXl  ing)  (30) 
(BE-PASS  be)  (EN-PASS  en)  (VERB  eat)  (BY-PASS  by)  (NP^  (a  boy))) 

Here  the  leftmost  occurrence  of  he  in  the  Structure  (30)  is  the  one  referred  to  in  the  definition  of  the 
transformation  I'here  Insertion  and  the  position  of  the  first  noun  phrase  is  moved  in  front  of  its 
affix: 


((COMP  comp)  (I  H  there)  (TENSE  p;ist)  (INFL  infi) 

(AUXl  be)  (NEGl  negl)  (NEG2  neg2)  (NP,  (acake))  (AFFIXl  ing)  (31) 

(BF;  PA.SS  be)  (EN  PASS  cn)  (VERB  eal)  (BY-PASS  by)  (NP^  (ahoy))) 

I  he  I  ransformational  Structure  (31)  produces  the  sentence;  "  Fhcrc  was  a  cake  being  eaten  by  a 
boy." 

Consider  now  die  question  of  the  commutativity  of  the  three  transl\)rmations  introduced  in  this 
section.  It  follows  from  the  definitions  that  There  Insertion  does  not  change  the  original  disposition 
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cf  the  noun  phrases  NP^.  NP^  and  NP,  in  the  1  ransfomiational  Siruclurc.  1  hcrefore.  since  There 
Insertion  does  not  interfere  with  the  action  of  Passive  and  Dative  Movement,  it  does  not  prevent 
these  transformations  from  permuting  or  interchanging  the  noun  phrases.  It  is  thus  possible  to 
apply  the  Passive  transformation  and  Dative  Movement  after  There  Insertion.  On  the  other  hand. 
Dative  Movement  and  Passive  may  freely  interchange  the  noun  phr;ises  in  the  I  S  because  it  makes 
no  difference  to  the  transformation  There  Insertion  which  of  the  noun  phrases  is  Icxated  in  the 
MPj-pt)sition.’''  There  Insertion,  therefore,  can  be  applied  after  Passive  and  Dative  Movement. 
Since  we  have  shown  that  There  Insertion  may  precede  or  follow  Passive  and  Dative  Movement,  and 
fnat  the  transformations  Passive  and  Dative  Movement  are  commutative,  it  follows  that  all  three 
tiansformations  introduced  in  this  section  are  commutative. 

1  he  application  of  There  Insertion  is  restricted  to  sentences  with  an  indcfmiie  noun  phriise  in  the 
^.P^-position.  but  the  transformations  Passive  d^nd  Dative  Movement  interchange  the  noun  phrases 
ifi  the  fransformational  Structure.  We.  therefore,  need  a  sentence  with  three  indefinite  noun 
phrases  to  provide  an  appropriate  example  for  showing  the  commutativity  of  the  transformations. 
In  this  case  the  result  of  application  of  There  Insertion  would  be  grammatical  regardless  of  the  order 
of  the  transformations.  Suppose  that  K  =  "A  man  was  reading  a  boy  some  interesting  stories."  If 
the  three  transformations  are  applied  in  the  order;  1.  There  Insertion,  2.  Passive,  3.  Dative 
Movement,  the  result  is: 

1.  After  There  Insertion:  There  was  a  man  reading  a  boy  sonic  interesting  stories. 

2.  After  Passive.  1  here  was  a  boy  being  read  some  interesting  stories  by  a  man. 

3.  After  Dative  Movement:  There  were  some  interesting  stories  being  read  to  a  boy  by  a  man. 

The  reverse  order  of  the  transformations:  1.  Dative  Movement,  2.  Passive,  3.  There  Insertion 
produces  the  following  sentences: 

1.  After  Dative  Movement:  A  man  was  reading  some  interesting  stories  to  a  boy. 

2.  After  Passive.  Some  interesting  stmics  were  being  read  to  a  boy  by  a  man. 

3.  After  There  Insertion:  There  were  some  interesting  stories  being  read  to  a  boy  by  a  man.^* 

30.  There  Insertion  merely  moves  the  NPj-posilion  in  the  Transformational  Structure  to  the  right 

31.  We  will  not  give  here  examples  of  all  possible  permutations  of  these  transformations  because  the  commutativity  of 
/’a.v.v/w’and  Dative  Movement  has  been  already  shown  before. 
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This  section  hiis  introduced  three  additional  transformations  that  refer  to  noun  phrase  positions  and 
their  values.’^  The  Passive  transformation  refers  to  the  positions  NP^.  NP^^.  and  NP^  permuting 
their  values.  Dative  Movement  refers  U'  the  semantic  values  goal  and  theme  and  interchanges  the 
corresponding  NP-positions.  There  Insertion  moves  the  NPj-position  in  the  fransformational 
Structure. 

Step  Ihree  of  the  Language  Genera: ion  PriKcdure  uses  the  constructed  system  of  optional 
commutative  Transformations,  the  set  o' conditionally  obligatory  Transformaiioiuil  I'iliers.  and  the 
set  of  ordered  obligatory  Adjustments  t )  "solve"  the  1  ASK  provided  by  Step  One  and  Step  fwo 
ai  d  to  produce  the  corresponding  English  text 


32.  I3ic  svsiem  toniiiiiis  olher  tninslornialions,  such  ;is  Ihc  Retaiive  iransformalion,  Impcraihr  and  Tag  Queslion.  bul 
ilicy  will  111)1  be  discussed  here. 
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AMI’I  NDI.X  1;  Pronominuli/ation 

I  he  program  GEN  which  implementii  Step  Three  of  the  Language  Generation  Procedure  "reads" 
the  input  I  ASK  supplied  by  Step  One  and  Step  Iwo  of  the  LGP  and  generates  the  appropriate 
word  string.  H  ich  element  of  the  TASK  consists  of  a  list  of  kernel  phrr.se  markers,  a  list  of 
transformaiioits,  and  a  syntactic  separator.  I  here  is  a  one-to-one  correspondence  between  each 
T  ASK  element  and  each  English  sentence  in  the  output.  Every  noun  phrase  in  a  generated 
sentence  derives  its  lexical  value  from  one  of  the  preposition  less  noun  frames,  or 

NF  '  ""',  of  the  Semantic  Frame  Structure.  Transfomiations  may  ititerchange  the  values  of  noun 
phrases,  but  the  actual  word  string  i;  never  altered;  it  can  only  be  transferred  into  another 
NP-position  in  the  Transformational  Staicture.  Therefore,  if  different  phrase  markers  of  the  TASK 
refer  to  the  same  noun  frame,  each  insu.nce  of  the  corresponding  noun  phnise  would  have  the  Siime 
lexical  value. 

This  repetition  is  awkward  and  in  order  to  make  the  text  more  fluent,  the  system  requires  a 
pronominalization  procedure  which  substitutes  the  repeated  noun  phrase  with  an  appropriate 
pronoun.  I  he  choice  of  the  pronoun  is  determined  by  two  parameters,  the  number  and  gender  of 
the  corresponding  noun  phrase.  The  values  of  these  two  parameters  can  be  computed  from  the 
number  and  gender  of  the  nouns  which  are  heads  of  the  noun  phrases  and  the  conjunctiotis  that 
connect  them.” 

I  he  pronominalization  procedure  is  activated  every  time  the  system  "reads"  the  next  element  of  the 
l  ASK  and  generates  the  corresponding  English  sentence.  In  order  to  decide  which  noun  phrase 
should  be  pronominalized,  two  subsequent  sentences,  referred  to  by  the  names  current  and 
previous,  are  examined. 

Definitions. 

CurretU-NP-list  is  a  list  of  all  noun  phrases  in  the  last  generated  (current)  sentence. 

Previous- NP- list  is  a  list  of  noun  phrases  in  the  /^rev/ous  sentence. 

Previous- pronouns- list  (P\‘\)  is  a  list  of  pronouns  corresponding  to  each  element  of  the  previous- NP- 1 ist}^' 


.13.  In  this  paper  we  will  not  describe  the  rules  Uiat  the  system  uses  to  calculate  the  number  and  gender  of  a  given  noun 
phrase,  f  or  instance,  the  number  of  the  noun  phrase  "Ivan  and  Maria"  is  "plural",  the  gender  is  "indilTerenl."  Or,  in  the 
case  of  anoilicr  noun  phrase,  "the  man  with  a  red  tie",  the  number  is  "singular",  Uie  gender  is  "masculine".  Similar  rules 
can  be  (()und  in  (Katz  1978j. 

34.  All  the  pronouns  contiiined  in  the  previous- pronouns-lisl  arc  in  the  nominative  case.  But  alter  the  decision  to 
pronominali/e  a  noun  phrase  has  been  made,  the  appropriate  lexical  form  of  a  pronoun  (nominative,  objective,  or 
piAsessive)  is  chosen  depending  f)n  the  case  of  the  corresponding  noun  phrase. 
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Suppose,  for  example,  that  the  following  two  scnlcnccs  were  gencraleil  by  ihe  system: 

"Maria  suspects  that  Tania  is  writing  a  letter  to  Ivan.  Tania  loves  Ivan."  (32) 

'n  this  example  we  have: 

currenl-N P-list  =  ( (Tania)  (Ivan)) 

previous- NP- list  -  ( (Maria)  (Tania)  (a  letter)  (Ivan)) 

previous- pronouns- list  =  ( (she)  (she)  (it)  (he) ) 

livery  noun  phrase  in  the  currenl-N P-list  which  is  also  present  in  the  previous-N P-list  is  a  possible 
candidate  for  pronominalization.  But  the  decision  to  pronominalize  each  noun  phriise  is  made  only 
j  .fier  comparing  the  pronoun  that  corresponds  to  the  noun  phrase  under  con  ^deration  with  all  the 
lAher  elements  of  the  PPL. 

Pronominalization  Rule:  A  repetitive  noun  phrase  in  the  current  scnience  is  replaced  by  its 
pronoun  only  if  the  pronoun  is  unique  in  the  previous-pronouns-list  (that  is,  no  other  noun 
phrases  in  the  previous  sentence  has  the  same  pronoun). 

in  the  example  (32)  the  program  will  not  substitute  the  pronoun  "she"  for  the  noun  phrase  "Tania" 
because  this  pronoun  is  not  unique  in  the  PPL  The  Pronominalization  Rule  helps  the  system  avoid 
ambiguity  that  arises  when  this  substitution  is  made:  "Maria  suspects  that  Tania  is  writing  a  letter  to 
Ivan.  She  loves  Ivan." 

On  the  other  hand,  since  there  is  only  one  occurrence  of  "he"  in  the  PPL.  the  noun  phrase  "Ivan" 
can  be  pronominalized,  resulting  in:  "Maria  suspects  that  Tania  is  writing  a  letter  to  Ivan.  Tania 
loves  him."” 

The  Pronominalization  Rule,  however,  is  a  necessary  but  not  a  sufficient  condition  for  the 
pronominalization  procedure.  In  some  cases  complementary  heuristic  rules  must  be  employed  in 
order  to  make  the  final  decision. 


35.  Ii  should  be  nolcd  lhal  more  than  one  pronoun  is  possible  in  a  sentence  as  long  as  the  Proiwminulizaiion  Rule  is  not 
v  iolated.  I  he  e.xample  is:  "Many  people  suspect  that  1  ania  is  writing  a  letter  to  Ivan.  She  loves  him." 
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Al’Pr  NDIX  2:  The  Parser 

This  section  describes  the  parser,  a  program  that  processes  kernel  sentences  and  builds  the 
corresponding  Semantic  Frame  Structu  res  using  the  three  types  of  templates  defined  in  Section  1  of 
this  paper; 

noun-template  (NT)  =  (prep*  dn*  adj*  noun) 

verb-template  (VT)  =  (tense  auvl  aux2  aux3  verb)  (34) 

adverb-template  (AT)  =  (mod  aJverb) 

Ivach  word  in  the  kernel  sentence  is  always  associated  with  a  unique  part  of  speech.’^  and.  therefore, 
with  a  unique  position  inside  one  of  the  templates  NT,  VT.  or  AT.  We  will  assume  that  a  kernel 
sentence  can  be  represented  by  the  folk.wing  sequence  of  frames:^’ 

j^piiiitial  pjpigciil  YP  ISjpoal  jsjplhcme  |^^pnnl^l 

l£ach  constituent  in  (35)  can  be  obtained  by  applying  the  two  operations  Concatenation  (CONC) 
t  nd  Conjunction  (CONJ)^*  to  the  templates  NT,  VT.  or  AT  in  (34).  All  constituents  are  optional; 
for  example,  the  presence  of  the  frames  NF®°'''  and  NF"’''"’’^  depends  on  the  type  of  main  verb  in 
the  kernel  sentence  (transitive,  intransitive,  or  double-transitive). 

The  parser  analyses  every  word  in  the  input  kernel  sentence,  scanning  it  from  left  to  right  and 
mapping  the  appropriate  pieces  of  the  word  string  rmto  the  corresponding  templates.  1  he  parser 
then  decides  which  of  the  templates  should  be  concatenated  or  conjoined  in  order  to  fonn  the 
necessary  noun-frame,  verb-frame,  or  adverb-frame.  Because  each  word  in  the  sentence  is 
associated  with  a  unique  template,  the  parser  starts  to  create  the  appropriate  type  of  template 
("opens"  the  template)  after  examining  the  very  first  word  in  the  sentence.  The  template  must  be 
filled  out  from  left  to  right.  If  any  element  in  the  template  is  left  unspecified,  the  parser  inserts  nil 
as  the  value  of  this  element.  When  all  the  elements  of  the  template  arc  filled  out.  the  parser 
"closes"  the  template.  Then,  depending  on  the  next  word  and  its  position  in  the  sentence,  the 
parser  has  two  choices; 

.t6.  llie  queslion  of  lexical  ambiguity,  that  is  the  case  when  one  word  can  serve  as  various  parts  of  speech,  is  not  discussed 
in  this  paper. 

37.  l  or  simplicity,  the  adverb  frames  AF'"'"'*’,  and  are  not  shown  here. 

38.  These  operations  are  defined  in  Section  1. 
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(a)  il  either  continues  the  construction  of  the  frame,  starting  to  create  another  instance  of  a 
template  of  the  same  type,  or 

(b)  it  "closes"  the  current  frame  and  begins  to  fill  out  the  elements  of  another  lemplaic. 
thereby  starting  a  new  frame. 

Here  is  an  example  to  clarify  the  procedure.  Suppose  that  the  parser  takes  the  following  scnicnce  as 
input: 

"In  the  evening  a  young  tall  man  with  blue  eyes  gave  Maria  a  beautiful  book  and  a  rose."  (36) 

''riggcred  by  the  preposition  "in",  the  parser  begins  the  construction  of  the  noun-frame  NP"’’"  ''  by 
filling  out  the  noun-template  as  follows,  ((prep  in)  (det  the)  (adj  nil)  (noun  evening)).  The  next 
word  in  the  sentence  is  the  determiner  "a",  which  indicates  the  absence  of  a  preposition  in  ihe  next 
noun-template,  and,  therefore,  suggests  that  the  frame  (NF"’"'*'  ((prep  in)  (det  the)  (adj  nil) 
(noun  evening)))  should  be  closed  and  that  the  construction  of  a  new  prepositionicss  noun-frame 
j^paijeo  begin.  This  frame  consists  of  the  concatenation  of  two  noun-templates: 

(NF'®""  ((prep  nil)  (det  a)  (adj  (young  tall))  (noun  man) 

(prep  with)  (det  nil)  (idj  blue)  (noun  eyes))) 

fhere  is  no  auxiliary  verbs  in  the  sentence  (36),  and  hence  the  parser  builds  from  the  verb  "gave" 
the  following  verb-frame  (VF  ((tense  past)  (auxl  nil)  (aux2  nil)  (aux3  nil)  (verb  give)))  with 
the  unspecified  auxiliary  elements.  Then,  the  word  "Maria"  forms  another  noun-frame  (NF®°'''‘ 
((prep  nil)  (det  nil)  (adj  nil)  (noun  Maria))).  Finally,  the  parser  uses  the  operation  Conjunction 
to  construct  the  last  prcposilionless  noun-frame  from  two  noiin-templates; 

^(yipihenic  ((prep  nil)  (det  a)  (adj  beautiful)  (noun  book)  (conj  and) 

(prep  nil)  (det  a)  (adj  nil)  (noun  rose))) 

The  Semantic  Frame  Structure  (37)  below  is  the  output  of  the  parser  after  processing  the 
sentence  (36): 
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((N  I-"”  '- ((prep  in)  (del  the)  (adj  nil)  (noun  evening))) 

(NF'-"”  ((prep  nil)  (del  a)  (adj  (young tall))  (noun  man) 

(prep  with)  (del  nil)  (adj  blue)  (noun  eyes))) 

(VF  ((tense  past)  (au\l  nil)  (au\2  nil)  (aux3  nil)  (verb  give)))  (37) 

(NF-”‘‘  ((prep  nil)  (del  nil)  (adj  nil)  (noun  Maria))) 

(NF'^""' ((prep  nil)  (del  a)  (adj  bcautirul)  (noun  book)  (conj  and) 

(prep  nil)  (del  a)  (ad*  nil)  (noun  rose)))) 

Let  us  consider  now  the  problem  of  closure  that  arises  in  two  different  contexts  in  the  parsing 
I  rocess;  the  closure  of  a  template  and  the  closure  of  a  frame. 

A  template  is  closed  after  a  certain  word  if: 

(a)  The  next  word  belongs  to  a  template  of  another  type. 

(b)  I  he  next  word  belongs  to  the  same  type  of  template,  but  corresponds  to  a  template 
clement  located  to  the  left  of  the  template  element  filled  last.^’ 

Suppose  now  that  a  template  has  just  been  closed.  The  closure  of  a  template  implies  the  closure  of 
a  frame  if: 

(a)  The  next  word  belongs  to  a  template  of  another  type.  (The  parser  will  then  start  to  create 
a  frame  of  the  new  type). 

(b)  The  next  word  is  an  element  of  a  noun-tcmplate^°  but  it  is  not  a  preposition,  (  fhe  parser 
star's  to  construct  a  new  preposition  less  noun-frame). 

If  these  conditions  are  not  satisfied,  the  parser  continues  the  construction  of  the  corresponding 
frame  using,  depending  on  the  next  word,  one  of  the  operations  Concatenation  or  Conjunction. 
The  rules  above  allow  the  parser  to  open  and  close  all  the  frames  in  the  kernel  phrase  marker  (35), 
except  the  last  one,  NF''"'^.  The  system  docs  not  have  a  syntactic  rule  which  can  determine,  when 
the  preposition  less  noun-frame  NF"’™*^^  ends  and  NF’’"'*'  begins.  What,  for  example,  should 
happen  in  the  sentence:  "Ivan  saw  Maria  with  the  binoculars"?  One  possible  reading  of  this 


39.  Remember  lh;U  :i  template  must  be  filled  out  from  left  to  right. 

40  We  assume  here  that  the  previous  template  was  also  a  noun-template;  otherwise,  the  condition  a.  holds. 
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‘•enienee.  where  the  parser  closes  the  flame  and  opens  NF'""’  as  soon  as  the  preposition 

with  has  been  encountered,  is  represented  below  in  the  Semantic  Frame  Structure  (38),  It  suggests 
that  Ivan  was  watching  Maria  through  his  binoculars: 

((NF®""  ((prep  nil)  (del  nil)  (adj  nil)  (noun  Ivan))) 

(VF  ((tense  past)  (auxl  nil)  (aux2  nil)  (aux3  nil)  (verb  see))) 

(38) 

(NF'*'""'' ((prep  nil)  (det  nil)  (adj  nil)  (noun  Maria))) 

(NF  '  **  ((prep  with)  (det  the)  (adj  nil)  (noun  binoculars)))) 

Another  reading  of  the  sentence  "Ivan  saw  Maria  with  the  binoculars"  is  represented  by  the 
Isemantic  Frame  Structure  (39).  In  ihis  case  the  parser  uses  the  operation  Concalenation  to 
continue  the  construction  of  the  noun-frame  NF'^'"""-'  after  finding  the  preposition  with.  I  his 
reading  suggests  that  Maria  had  the  binoculars  at  the  time  when  Ivan  saw  her: 

((NF'**^"' '  ((prep  nil)  (det  nil)  (adj  nil)  (noun  Ivan))) 

(VF  ((tense  past)  (auxl  nil)  (aux2  nil)  (aux3  nil)  (verb  see)))  (39) 

(NF’^'-"'‘^((prep  nil)  (det  nil)  (adj  nil)  (noun  Maria) 

(prep  with)  (det  the)  (adj  nil)  (noun  binoculars)))) 

The  problem  of  attaching  the  last  prepositional  phrase  (pp''"''^  Attachment)  requires  Uie  use  of 
semantic/syntactic  interaction  for  its  resolution  [Marcus  1979]  and  will  not  be  discussed  here/' 

I  he  parser  described  here  is  restricted  to  processing  the  kernel  sentences  of  the  general  form  (35). 
However,  more  complicated  sentences  with  several  clauses  can  also  be  analyzed  by  the  paiser  if  a 
mechanism  that  splits  the  sentence  into  kernels  «s  provided.  As  an  example,  consider  the  sentences 
with  embedded  clauses  generated  by  the  Language  Generation  Procedure  with  the  help  of  the 
Connective  Transformations  Table  1  in  Section  6).  'I  he  use  of  simple  heuristic  procedures  (for 
example,  counting  the  number  of  verbs  and  noun  phrases,  or  searching  for  certain  values  of  the 
complementizers  COMP  and  INFL)  appears  to  be  sulTicient  for  rccon.structing  the  kernels  (matrix 
clause  and  embedded  clause)  which  form  every  complex  sentence  in  fable  1.  For  instance,  the 

41.  At  this  poinl.  the  parser  makes  the  decision  based  on  a  lisl  of  prepositions  which  "usually"  beuin  a  new  noun-rrainc 
(I  e.  through). 
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senlcncc  "Ivan  claims  lo  have  wrillen  that  leller”  consists  of  two  clanses;  "Iva.i  claims  ii"  am!  "Ivan 
has  wrillen  that  leiter".  which  have  been  combined  by  the  iraiislbrmaiion  0-0- 10.  ihe  possibility 
to  reconstruct  the  kernels  allows  the  parser  to  process  any  sentence  generated  b>  the  Connective 
I'ninsformations. 

Suppose  that  the  input  to  the  parser  consists  of  several  connected  sentences  a  eoliereni  levi).  .iiul 
that  a  pR)nomina.i/alion  procedure  had  been  employed  by  the  writer  in  older  lo  make  the  te\; 
more  lluent.  If  this  procedure  had  been  accomplished  obeying  the  Pronuminulization  Rule  staled  in 
Appendi.x  1.  the  parser  can  easily  resolve  the  anuphor.  i.e.  restore  the  noun  phrase.',  wh.ieh  were 
replaced  by  the  pronouns. 

Phis  parser  has  been  used  iis  a  front  end  for  Winston's  learning  system  [Winston  IhSOj.  It  translates 
P'nglish  descriptions  of  situations  into  descriptions  in  the  extensible-relation  representation.  Ibis 
rcpresenlation  was  suggested  by  Winston  and  is  implemented  in  his  learning  s\stem  using  a  version 
of  Frame  Representation  language  [Roberts  and  Goldstein  1977].  In  FRF.  an  agent-act- theme 
combination  is  expressed  ;is  a  frame,  a  slot  in  the  frame,  and  a  value  in  the  slot.  In  the 
extensible-relation  representation,  a  supplementary  description  node  for  an  agent-act-iheme 
combination  is  expressed  as  a  comment  /rame  attached  to  the  frame-slol-value  combination. 

Suppose,  for  example,  that  the  foliow'ing  English  text  is  the  input  to  the  parser: 

In  the  beginning  of  the  story  Duncan  was  a  king.  Macbeth  was  a  happy 
noble.  He  married  l.ady-Macbeth.  She  wtis  a  greedy  and  ambitious 
woman.  She  wanted  Macbeth  to  be  king.  He  also  desired  to  be  the  king. 
Lady-Macbeth  persuaded  him  to  murder  Duncan.  Soon  Lady-Macbeth 
decided  to  kill  herself  Macdufl'  was  a  loyal  noble.  He  became  angry. 

Macbeth's  murder  of  Duncan  caused  him  lo  kill  Macbeth. 

Iklow  follow  the  frames  which  were  generated  after  parsing  the  input  text.  Here,  AKO  stands  for 
A-KIND-OF.  and  HP  -  for  HAS-PROPERTY  relations. 

(DUNCAN  (ako  (KING))) 

(MACBETH  (ako  (NOBLE)  (KING  (ako-1))) 

(hp  (HAPPY)) 

(marry  (LADY-MACBETH)) 

(desire  (ako-1)) 

(murder  (DUNCAN  (murder-1)))) 


(LADY-MACBETH  (ako  (WOMAN)) 

(hp  (GREEDY)  (AMBITIOUS)) 
(want  (ako-1)) 

(persuade  (murder- 1)) 

(kill  (LADY-MACBETU  (kill-1))) 
(decide  (kill-1))) 

(MACDUFF  (ako  (NOBLE)) 

(hp  (LOYAL)  (ANGRY)) 

(kill  (MACBETH  (kill-2)))) 

(AKO-1  (frame  (MACBETH)) 

(slot  (AKO)) 

(value  (KING))) 

( M  U  R  D  T  R  I  ( frame  ( M  AC  BE  TH )) 

(slot  (MURDER)) 

(value  (DUNCAN)) 

(aiuse  (KILL-2))) 

(KILL-1  (frame  (LADY-MACBETH)) 

(slot  (KILL)) 

(value  (LADY-MACBETH))) 

(KlLL-2  (frame  (MACDUFF)) 

(slot  (Kll.L)) 

(value  (MACBETH))) 
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